-- Logs begin at Wed 2022-08-24 11:05:59 UTC, end at Wed 2022-08-24 12:02:17 UTC. -- Aug 24 11:31:24.663471 dv-cinder-846054-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 11:31:24.670671 dv-cinder-846054-1-smb devstack@keystone.service[88073]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 11:31:24.672713 dv-cinder-846054-1-smb devstack@keystone.service[88073]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 11:31:24 2022] *** Aug 24 11:31:24.672713 dv-cinder-846054-1-smb devstack@keystone.service[88073]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 11:31:24.672713 dv-cinder-846054-1-smb devstack@keystone.service[88073]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 11:31:24.672713 dv-cinder-846054-1-smb devstack@keystone.service[88073]: nodename: dv-cinder-846054-1-smb Aug 24 11:31:24.672713 dv-cinder-846054-1-smb devstack@keystone.service[88073]: machine: x86_64 Aug 24 11:31:24.672713 dv-cinder-846054-1-smb devstack@keystone.service[88073]: clock source: unix Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: pcre jit disabled Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: detected number of CPU cores: 4 Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: current working directory: / Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: detected binary path: /usr/bin/uwsgi-core Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: your processes number limit is 47680 Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: your memory page size is 4096 bytes Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: detected max file descriptor number: 2048 Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: lock engine: pthread robust mutexes Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: thunder lock: enabled Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 11:31:24.673839 dv-cinder-846054-1-smb devstack@keystone.service[88073]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 11:31:24.712965 dv-cinder-846054-1-smb devstack@keystone.service[88073]: Python main interpreter initialized at 0x55fdb79ce9c0 Aug 24 11:31:24.712965 dv-cinder-846054-1-smb devstack@keystone.service[88073]: python threads support enabled Aug 24 11:31:24.712965 dv-cinder-846054-1-smb devstack@keystone.service[88073]: your server socket listen backlog is limited to 100 connections Aug 24 11:31:24.712965 dv-cinder-846054-1-smb devstack@keystone.service[88073]: your mercy for graceful operations on workers is 90 seconds Aug 24 11:31:24.713369 dv-cinder-846054-1-smb devstack@keystone.service[88073]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 11:31:24.713452 dv-cinder-846054-1-smb devstack@keystone.service[88073]: *** Operational MODE: preforking *** Aug 24 11:31:24.713704 dv-cinder-846054-1-smb devstack@keystone.service[88073]: *** uWSGI is running in multiple interpreter mode *** Aug 24 11:31:24.713704 dv-cinder-846054-1-smb devstack@keystone.service[88073]: spawned uWSGI master process (pid: 88073) Aug 24 11:31:24.713916 dv-cinder-846054-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 11:31:24.714613 dv-cinder-846054-1-smb devstack@keystone.service[88073]: spawned uWSGI worker 1 (pid: 88085, cores: 1) Aug 24 11:31:24.714811 dv-cinder-846054-1-smb devstack@keystone.service[88073]: spawned uWSGI worker 2 (pid: 88086, cores: 1) Aug 24 11:31:24.714964 dv-cinder-846054-1-smb devstack@keystone.service[88073]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 11:31:29.022568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:31:29.022568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: from cryptography.utils import int_from_bytes Aug 24 11:31:29.023353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:31:29.023353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: from cryptography.utils import int_from_bytes Aug 24 11:31:29.024876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:31:29.024876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: from cryptography.utils import int_from_bytes Aug 24 11:31:29.025331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:31:29.025331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: from cryptography.utils import int_from_bytes Aug 24 11:31:29.073103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:31:29.073318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:31:29.073470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] command line args: [] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:31:29.073738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:31:29.073916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ================================================================================ {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:31:29.074167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] admin_token = **** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.074409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] config_dir = [] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.074596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.074787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] config_source = [] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.074976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] debug = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.075173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.075496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:31:29.075585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.075648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:31:29.075707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.075850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] command line args: [] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:31:29.075944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.076130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:31:29.076210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.076307 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ================================================================================ {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:31:29.076381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] list_limit = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.076554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] log_config_append = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.076641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] admin_token = **** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.076747 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.076851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] config_dir = [] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.076954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] log_dir = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.077049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.077156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] log_file = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.077261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] config_source = [] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.077371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.077512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] debug = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.077512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.077721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.077808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.077933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] list_limit = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] log_config_append = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.078973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.079110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.079728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] log_dir = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.079860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.079944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] log_file = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.080124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.080255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.080374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.080507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.080637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.080778 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.080864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.080947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.081075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.081075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.081257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.081339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.081538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.081636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.081777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.081865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] publish_errors = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.082006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.082085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.082240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.082360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.082442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.082520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.082650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.082728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.082917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.083010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.083153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] standard_threads = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.083231 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.083382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.083623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.083701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.083794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.083867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] publish_errors = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.083943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] use_journal = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.084100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.084199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] use_json = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.084280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] use_stderr = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.084358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.084433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] use_syslog = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.084498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.084650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.084735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.084903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.084983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.085138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.085223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] standard_threads = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.085399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.085490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.085635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.085714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.085813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.085889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.085993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] use_journal = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.086105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.086194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] use_json = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.086333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] use_stderr = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.086410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.086510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] use_syslog = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.086594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.086742 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:31:29.086852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.087026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.087105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.087267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.087344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.087513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.087599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.087757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.087834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.087988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.088065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.088233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.088319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.088477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.088562 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.088712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.088791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.088961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.089047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.089208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.089292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.089448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.089524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.089682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.089770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.089930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.090008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.090165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.090243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.090417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.090572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.090652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.090723 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.090899 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.090979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.091129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.091215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.091356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.091436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.091590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.091668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.091835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.091920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.092079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.092158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.092306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.092383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.092533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.092617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.092774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.092852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.093016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.093101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.093250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.093330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.093479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.093557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.093708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.093784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.093942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.094021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.094173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.094258 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.094400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.094478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.094628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.094706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.095531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.095648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.095775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.095907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.096933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.097013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.097126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.097249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.097360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.097494 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.097594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.097722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.097828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.097957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.098067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.098190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.098318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.098667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.098742 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.098851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.098933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.099972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.100088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.100226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.100318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.100446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.100523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.100672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.100770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.100928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.101047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.101129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.101255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.101398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.101503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.101631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.101771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.101876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.102027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.102106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.102290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.102378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.102542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.102625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.102791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.102880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.103037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.103120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.103270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.103348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.103503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.103583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.103742 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.103828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.103976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.104055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.104213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.104291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.104445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.104527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.104680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.104759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.104916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.105035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.105175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.105261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.105410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.105494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.105663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.105788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.105894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.105983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.106135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.106212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.106369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.106445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.106607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.106698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.106868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.106959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.107099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.107177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.107329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.107417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.107560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.107642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.107794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.107873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.108024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.108181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.108257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.108328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.108481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.108561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.108727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.108814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.108963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.109043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.109199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.109276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.109442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.109520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.109677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.109756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.109906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] auth.external = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.109983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.110136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.110214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.110374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.110502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.110672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.110900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.111024 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.111094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] auth.password = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.111174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.111255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] auth.token = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.111474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.111560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.111709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.111789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.111955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.112045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.112185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.112277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.112430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.112511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.112675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.112754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] auth.external = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.112905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.112987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.113137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] credential.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.113217 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.113381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.113461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.113626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.113707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] auth.password = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.113872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.113952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] auth.token = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.114108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.114188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.114346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.114426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.114575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.114654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.114842 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.114925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.115098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.115209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.115334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.115428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.115568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.115646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.115808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] credential.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.115889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.116058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.116144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.116310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.116397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.116553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.116633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.116793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.116873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.117027 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] federation.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.117106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.117262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.117343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.117507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.117586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.117748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.117827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.117975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.118056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.118217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.118298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.118451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.118531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.118701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.118796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.118977 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.119109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.119230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.119356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.119465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.119616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.119695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.119856 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] federation.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.119935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.120100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.120181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.120351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.120431 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.120601 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.120680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.120830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.120910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.121071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.121152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.121298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.121378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.121533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.121614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.121778 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.121856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.122023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.122101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.122250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.122326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.122467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.122548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.122695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.122797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.122964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.123046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.123208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.123288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.123450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.123529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.123689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.123771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.123929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.124008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.124163 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.124248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.124405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.124490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.124641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.124719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.124870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.124949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.125106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.125226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.125336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.125416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.125568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.125648 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.125802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.125882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.126038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.126680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.126834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.126902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.127055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.127191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.127320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.127460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.127678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.127804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.127941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.128067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.128195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.128321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.128448 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.128574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.128713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.128843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.128970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.129097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.129225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.129363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.129363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.129610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.129737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.129865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.129865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.130103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.130237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.130363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.130490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.130614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.130741 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.130955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.131083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.131220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.131347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.131479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.131604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.131739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.131865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.131993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.132364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.132490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.132617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.132750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.132876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.133000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.133137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.133267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.133388 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.133521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.133648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.133774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.133902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.134029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.134156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.134290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.134417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.134542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.134670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.134809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.134942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.135080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.135206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.135349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.135476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.135603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.135735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.135870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.135996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.136124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.136249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.136374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.136499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.136635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.136774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.136901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.137027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.137150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.137274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.137409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.137538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.137665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.137793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.137919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.137919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.138164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.138164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.138418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.138551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.138677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.138852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.138988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.139117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.139245 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.139372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.139499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.139626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.139759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.139759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.139998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.140125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.140262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.140390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.140524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.140651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.140777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.140904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.141030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.141155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.141294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.141423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.141548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.141674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.142372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.142501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.142649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.142788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.142916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.143041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.143242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.143369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.143505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.143635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] resource.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.143635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.143876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.143876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.144116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.144251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.144388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.144522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.144651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.144778 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.144905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145040 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] role.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.145943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] role.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] resource.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146816 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.146891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147337 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147620 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.147913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] role.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] role.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.148934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.149006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.149077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.149182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.149294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.149418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.149547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.149673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.149784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.149925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.150037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.150171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.150277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.150402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.150528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.150672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.150849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.150988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.151118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.151245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.151373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.151500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.151637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.151764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.151894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.152021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.152149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.152276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.152421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.152547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.152674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] token.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.152800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.152929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.153056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.153191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.153317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.153444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.153570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.153699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.153831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.153967 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.154103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.154229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.154356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.154483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.154610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.154746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.154901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.155030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.155157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.155284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.155409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.155544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.155672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.155799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.155935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.156063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.156187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] token.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.156321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.156447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.156571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.156697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.156824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.156951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.157084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.157210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.157373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.connection = **** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.157466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.157537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.157599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.157823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.157956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.158086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.158212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.158340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.158340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.158714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.158882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.159011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.159140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.159269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.159415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.159551 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.159679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.159806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.159932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.160059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.160187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.160322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.160448 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.160575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.160701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.160828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.160955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.connection = **** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.161094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.161242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.161379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.161506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.161634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.161760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.161887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.161887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:31:29.162136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.162136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.162136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.162136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.162136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.162136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.162850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.162850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.162850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.163208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.163208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.163446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.163668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.163911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.164148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:31:29.164323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:31:29.190475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.190708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.190954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.193614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.193822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.194058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.199377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.202541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.228222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.228433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.229730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.229965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.281971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.282692 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.331346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.331572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.332590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.332834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.492529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.492701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.492791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.492872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.492968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.493047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.493124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.493198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.493273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.493424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.493511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.493646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.517393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.517625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.517722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.517975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.518073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.518204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.518295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.518373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.518462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.518540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.518613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.518781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.518869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.519024 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.530075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.530505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.543240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.543437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.543531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.543674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.543762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.543895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.543983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.544114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.544208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.544330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.544412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.544545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88086) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.544627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.544762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 11:31:29.562004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.562204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 11:31:29.562563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.562748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 11:31:29.563048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.563289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.563375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.563504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 11:31:29.564426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.564526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.564691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.564775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 11:31:29.565164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.565436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.565972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.566243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.573963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.574237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.574506 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.574812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.575629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.575914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.576191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.576481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.581743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.583656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.584629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.584913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.585201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.585484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.585768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.586030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.586303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.586547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.586677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.586915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.587045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.587187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.587318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.587446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.587585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.587714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.587943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.588219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.588502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.588896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.589182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.589461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.610046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.612139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.612425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.612729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.614207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.614498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.617063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.617352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.617639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.619177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.619471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.619761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.623922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.624210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.626123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.626743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.628345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.628638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.628926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.629213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.629492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.629771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.630054 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.630325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.630908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.631220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.631513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.631803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.632332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.632628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.632907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.633183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.648106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.648394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.650920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.651209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.652228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.655084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.655432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.655730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.658882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.659185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.660508 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.663401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.663676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.666555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.666892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.667197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.667488 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.667780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.668062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.668352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.669817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.670125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.670420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.670717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.671029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.671334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.684363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.684656 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.684926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.685209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.688447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.688867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.688867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.689492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.692078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.693583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.693861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.696190 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.696508 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.696796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.697095 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.697387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.697665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.697847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.697992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.700648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.700941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.701243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.701536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.701834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.709404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.709689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.709973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.710256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.710539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.710845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.711127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.713615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.713909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.714198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.714488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.714796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.715086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.715369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.726339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.729376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.731176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.732273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.733697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.734187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.735182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.735466 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.736370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.737849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.739396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.740926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.741217 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.741520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.742852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.744256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.747127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.747420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.747709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.747994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.748128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.749469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.752752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.753050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.753370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.753660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.756118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.756414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.756699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.761826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.762126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.762416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.763794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88086) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.764084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.764367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.764644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.764921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.765209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.765486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.765755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.766043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.766313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.766601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.767714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.767714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.768059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88086) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.769815 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 11:31:29.770107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.770396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.770680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.771001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.771279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.771561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.771845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.772131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.772406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.772691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.772977 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.773249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.773513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 11:31:29.802068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdb79ce9c0 pid: 88086 (default app) Aug 24 11:31:29.805948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8f8a4-1190-4a0f-9238-f11e06f69cb4 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:29.806232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8f8a4-1190-4a0f-9238-f11e06f69cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:29.806520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8f8a4-1190-4a0f-9238-f11e06f69cb4 None None] PATH_INFO: `/v3` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:29.809147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdb79ce9c0 pid: 88085 (default app) Aug 24 11:31:29.810664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Wed Aug 24 11:31:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:36.462058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30455d9d-48e1-422d-bfec-fdf78e3833f0 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:36.462590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30455d9d-48e1-422d-bfec-fdf78e3833f0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:36.462590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30455d9d-48e1-422d-bfec-fdf78e3833f0 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:36.466864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:31:36.474342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:36.474790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:36.474922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:36.545709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: INFO dbcounter [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] Registered counter for database keystone Aug 24 11:31:36.565049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:31:36.571224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writer thread running {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:31:36.753882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG passlib.handlers.bcrypt [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88086) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 11:31:36.754207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG passlib.handlers.bcrypt [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88086) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 11:31:36.810110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:36.811743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:36.947586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 11:31:37.437325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30455d9d-48e1-422d-bfec-fdf78e3833f0 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:37.506636 dv-cinder-846054-1-smb devstack@keystone.service[88085]: INFO dbcounter [None req-30455d9d-48e1-422d-bfec-fdf78e3833f0 None None] Registered counter for database keystone Aug 24 11:31:37.529909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG oslo_db.sqlalchemy.engines [None req-30455d9d-48e1-422d-bfec-fdf78e3833f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:31:37.537033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writer thread running {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:31:37.660893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30455d9d-48e1-422d-bfec-fdf78e3833f0 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:37.665221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afdf9c-dc49-4459-b624-8d0238e5c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:37.665848 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afdf9c-dc49-4459-b624-8d0238e5c8fb admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:37.666133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afdf9c-dc49-4459-b624-8d0238e5c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:37.666409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afdf9c-dc49-4459-b624-8d0238e5c8fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:37.675185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afdf9c-dc49-4459-b624-8d0238e5c8fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:37.728349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WARNING keystone.common.rbac_enforcer.enforcer [None req-03afdf9c-dc49-4459-b624-8d0238e5c8fb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 11:31:37.728634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afdf9c-dc49-4459-b624-8d0238e5c8fb admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:37.739508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Wed Aug 24 11:31:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 11:31:37.745821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:37.765090 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7cbb6-6b90-4e58-86f7-48786a609b3d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:37.769768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2ab8f-4fd1-40e1-bd1e-321dbe373ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:37.770926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2ab8f-4fd1-40e1-bd1e-321dbe373ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:37.771212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2ab8f-4fd1-40e1-bd1e-321dbe373ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:37.771483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2ab8f-4fd1-40e1-bd1e-321dbe373ca5 admin admin] PATH_INFO: `/v3/projects/366850b748b7483f9a23090a350c7e5e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:37.773073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2ab8f-4fd1-40e1-bd1e-321dbe373ca5 admin admin] RBAC: Authorizing `identity:get_project(project_id=366850b748b7483f9a23090a350c7e5e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:37.828909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0da2ab8f-4fd1-40e1-bd1e-321dbe373ca5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 11:31:37.829255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2ab8f-4fd1-40e1-bd1e-321dbe373ca5 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:37.834068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Wed Aug 24 11:31:37 2022] GET /identity/v3/projects/366850b748b7483f9a23090a350c7e5e => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:39.731998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8654cd-330e-4da9-9e4a-a0907b663230 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:39.732512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8654cd-330e-4da9-9e4a-a0907b663230 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:39.732512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8654cd-330e-4da9-9e4a-a0907b663230 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:39.736818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:39.742195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe05a54-6193-4ecf-a4cf-5a64d6ddb3b9 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:39.742620 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe05a54-6193-4ecf-a4cf-5a64d6ddb3b9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:39.742742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe05a54-6193-4ecf-a4cf-5a64d6ddb3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:39.763521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4fe05a54-6193-4ecf-a4cf-5a64d6ddb3b9 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:39.765054 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4fe05a54-6193-4ecf-a4cf-5a64d6ddb3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:39.773751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 11:31:40.049063 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8654cd-330e-4da9-9e4a-a0907b663230 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:40.061845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8654cd-330e-4da9-9e4a-a0907b663230 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:40.067752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0099e-599b-4fe9-be97-e4fc53accf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:40.068354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0099e-599b-4fe9-be97-e4fc53accf66 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:40.068640 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0099e-599b-4fe9-be97-e4fc53accf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:40.068917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0099e-599b-4fe9-be97-e4fc53accf66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:40.076729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0099e-599b-4fe9-be97-e4fc53accf66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:40.078510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0099e-599b-4fe9-be97-e4fc53accf66 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:40.087812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Wed Aug 24 11:31:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 11:31:40.093413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe05a54-6193-4ecf-a4cf-5a64d6ddb3b9 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:40.103819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe05a54-6193-4ecf-a4cf-5a64d6ddb3b9 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:40.108256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96da135-acb9-4083-a82f-68ddc5b91189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:40.108884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96da135-acb9-4083-a82f-68ddc5b91189 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:40.109164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96da135-acb9-4083-a82f-68ddc5b91189 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:40.109438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96da135-acb9-4083-a82f-68ddc5b91189 admin admin] PATH_INFO: `/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:40.111340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96da135-acb9-4083-a82f-68ddc5b91189 admin admin] RBAC: Authorizing `identity:get_user(user_id=6889fd2ecc6c467f8af1a4d5c4e42fb5)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:40.113262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96da135-acb9-4083-a82f-68ddc5b91189 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:40.114815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Wed Aug 24 11:31:40 2022] GET /identity/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:42.121925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade167b7-d78e-4bc3-9343-bc0c8a73cae7 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:42.122487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade167b7-d78e-4bc3-9343-bc0c8a73cae7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:42.122487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade167b7-d78e-4bc3-9343-bc0c8a73cae7 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:42.123873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:31:42.130245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be4b3-6081-494f-93c2-58ee5c7fdfba None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:42.130402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f64c-74d7-458c-9979-aee3f22c32dd None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:42.130836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be4b3-6081-494f-93c2-58ee5c7fdfba None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:42.130836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be4b3-6081-494f-93c2-58ee5c7fdfba None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:42.130992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f64c-74d7-458c-9979-aee3f22c32dd None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:42.131111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f64c-74d7-458c-9979-aee3f22c32dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:42.132041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:31:42.137445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bb93d-37c4-44cd-8457-74c6c8d746e5 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:42.137737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bb93d-37c4-44cd-8457-74c6c8d746e5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:42.138018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bb93d-37c4-44cd-8457-74c6c8d746e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:42.150735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9d48f64c-74d7-458c-9979-aee3f22c32dd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:42.151955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9d48f64c-74d7-458c-9979-aee3f22c32dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:42.180862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG passlib.handlers.bcrypt [None req-ca3bb93d-37c4-44cd-8457-74c6c8d746e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88085) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 11:31:42.181297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG passlib.handlers.bcrypt [None req-ca3bb93d-37c4-44cd-8457-74c6c8d746e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88085) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 11:31:42.227910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ca3bb93d-37c4-44cd-8457-74c6c8d746e5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:42.229531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ca3bb93d-37c4-44cd-8457-74c6c8d746e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:42.237831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:31:42.338209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:31:42.524995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f64c-74d7-458c-9979-aee3f22c32dd None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:42.550779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:42.602086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bb93d-37c4-44cd-8457-74c6c8d746e5 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:42.650584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f64c-74d7-458c-9979-aee3f22c32dd None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:42.686160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74c63b-7d62-44cf-affa-92fa3a275dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:42.686823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74c63b-7d62-44cf-affa-92fa3a275dad None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:42.687114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74c63b-7d62-44cf-affa-92fa3a275dad None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:42.687402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74c63b-7d62-44cf-affa-92fa3a275dad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:42.700000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74c63b-7d62-44cf-affa-92fa3a275dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-ef74c63b-7d62-44cf-affa-92fa3a275dad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:31:42.709418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:31:42.710479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:31:42.711761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:31:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:31:42.712829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bb93d-37c4-44cd-8457-74c6c8d746e5 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:42.715187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:42.716414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74c63b-7d62-44cf-affa-92fa3a275dad None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:42.753361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69941d9f-ae05-4bbc-bdd3-17da551b8294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:42.754237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69941d9f-ae05-4bbc-bdd3-17da551b8294 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:42.754525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69941d9f-ae05-4bbc-bdd3-17da551b8294 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:42.754829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69941d9f-ae05-4bbc-bdd3-17da551b8294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:42.801966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:42.821610 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74c63b-7d62-44cf-affa-92fa3a275dad None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:42.824497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69941d9f-ae05-4bbc-bdd3-17da551b8294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:42.825371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69941d9f-ae05-4bbc-bdd3-17da551b8294 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:42.857723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d2233-a440-4ac7-947b-cd1dc3983671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:42.858332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2233-a440-4ac7-947b-cd1dc3983671 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:42.858615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2233-a440-4ac7-947b-cd1dc3983671 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:42.858920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2233-a440-4ac7-947b-cd1dc3983671 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:42.859614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2233-a440-4ac7-947b-cd1dc3983671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:42.859902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2233-a440-4ac7-947b-cd1dc3983671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:42.862166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2233-a440-4ac7-947b-cd1dc3983671 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:42.875022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:31:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:31:42.883397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d2233-a440-4ac7-947b-cd1dc3983671 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:42.926422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:42.932168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69941d9f-ae05-4bbc-bdd3-17da551b8294 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:42.935305 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:42.986629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d2233-a440-4ac7-947b-cd1dc3983671 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:43.021490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3a607-a4d6-4ab0-80a7-9112f5c078a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:43.022128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3a607-a4d6-4ab0-80a7-9112f5c078a3 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:43.022414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3a607-a4d6-4ab0-80a7-9112f5c078a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:43.022694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3a607-a4d6-4ab0-80a7-9112f5c078a3 None admin] PATH_INFO: `/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:43.023880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3a607-a4d6-4ab0-80a7-9112f5c078a3 None admin] RBAC: Authorizing `identity:get_user(user_id=6889fd2ecc6c467f8af1a4d5c4e42fb5)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:43.025348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3a607-a4d6-4ab0-80a7-9112f5c078a3 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:43.026994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:31:42 2022] GET /identity/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:43.032613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3a607-a4d6-4ab0-80a7-9112f5c078a3 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:43.038052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69941d9f-ae05-4bbc-bdd3-17da551b8294 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:43.047656 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:43.072535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca965e-30a6-469d-9b28-56e34bec3d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:43.073317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca965e-30a6-469d-9b28-56e34bec3d8e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:43.073599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca965e-30a6-469d-9b28-56e34bec3d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:43.073875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca965e-30a6-469d-9b28-56e34bec3d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:43.092754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca965e-30a6-469d-9b28-56e34bec3d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:43.094236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca965e-30a6-469d-9b28-56e34bec3d8e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-a9ca965e-30a6-469d-9b28-56e34bec3d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:31:43.115566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:31:43.116469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:31:43.117281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:31:43.117281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:31:43.117281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:31:43.117281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 9/18] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:31:43.122497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca965e-30a6-469d-9b28-56e34bec3d8e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:43.133915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3a607-a4d6-4ab0-80a7-9112f5c078a3 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:43.168616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a81f2-5b67-46cb-8c9a-c6d408c17ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:43.169244 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a81f2-5b67-46cb-8c9a-c6d408c17ddc None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:43.169528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a81f2-5b67-46cb-8c9a-c6d408c17ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:43.169798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a81f2-5b67-46cb-8c9a-c6d408c17ddc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:43.170964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a81f2-5b67-46cb-8c9a-c6d408c17ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:43.172434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a81f2-5b67-46cb-8c9a-c6d408c17ddc None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:43.174877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 10/19] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:31:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:31:43.180417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a81f2-5b67-46cb-8c9a-c6d408c17ddc None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:43.182181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:43.227544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca965e-30a6-469d-9b28-56e34bec3d8e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:43.262288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e0487-8798-4bff-97c2-0756d41b5f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:43.262934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e0487-8798-4bff-97c2-0756d41b5f43 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:43.263229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e0487-8798-4bff-97c2-0756d41b5f43 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:43.263522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:43.263632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e0487-8798-4bff-97c2-0756d41b5f43 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:43.264141 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e0487-8798-4bff-97c2-0756d41b5f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:43.264452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e0487-8798-4bff-97c2-0756d41b5f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:43.265863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e0487-8798-4bff-97c2-0756d41b5f43 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:43.284296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a81f2-5b67-46cb-8c9a-c6d408c17ddc None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:43.286632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 10/20] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:31:43.322935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7a0fc-5986-42b2-8298-fbdcab2cc216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:43.323487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7a0fc-5986-42b2-8298-fbdcab2cc216 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:43.323773 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7a0fc-5986-42b2-8298-fbdcab2cc216 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:43.324049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7a0fc-5986-42b2-8298-fbdcab2cc216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:43.324788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7a0fc-5986-42b2-8298-fbdcab2cc216 None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.domain.id=default, user.id=6889fd2ecc6c467f8af1a4d5c4e42fb5) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:43.325098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7a0fc-5986-42b2-8298-fbdcab2cc216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:43.326585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7a0fc-5986-42b2-8298-fbdcab2cc216 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:43.334468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 11/21] 10.222.0.59 () {56 vars in 1322 bytes} [Wed Aug 24 11:31:43 2022] GET /identity/v3/role_assignments?user.id=6889fd2ecc6c467f8af1a4d5c4e42fb5&scope.domain.id=default&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:31:45.405126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52e597-850c-4060-ace6-e690eaa09f43 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:45.405629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52e597-850c-4060-ace6-e690eaa09f43 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:45.405756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52e597-850c-4060-ace6-e690eaa09f43 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:45.407025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 11/22] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:45.412383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4835c-7a05-48cf-8940-d59adb5d6db8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:45.412807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4835c-7a05-48cf-8940-d59adb5d6db8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:45.412992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4835c-7a05-48cf-8940-d59adb5d6db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:45.437452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-67b4835c-7a05-48cf-8940-d59adb5d6db8 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:45.438664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-67b4835c-7a05-48cf-8940-d59adb5d6db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:45.514152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 12/23] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:31:45.680794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0da0b-f0bb-49fc-9f44-2c0702623cdf None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:45.681082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0da0b-f0bb-49fc-9f44-2c0702623cdf None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:45.681281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0da0b-f0bb-49fc-9f44-2c0702623cdf None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:45.682758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 12/24] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:45.687968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984334c-b646-43e5-911a-7ba4d7814567 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:45.688257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984334c-b646-43e5-911a-7ba4d7814567 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:45.688536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984334c-b646-43e5-911a-7ba4d7814567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:45.711742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a984334c-b646-43e5-911a-7ba4d7814567 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:45.712954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a984334c-b646-43e5-911a-7ba4d7814567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:45.784193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 13/25] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:45.890240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58b9c-9fe1-4f9d-b115-c15f2bc2acb5 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:45.890579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58b9c-9fe1-4f9d-b115-c15f2bc2acb5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:45.890820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58b9c-9fe1-4f9d-b115-c15f2bc2acb5 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:45.892262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 13/26] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:45.897830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a371851-5a42-4e24-b000-e816cd1a99d0 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:45.898121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a371851-5a42-4e24-b000-e816cd1a99d0 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:45.898397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a371851-5a42-4e24-b000-e816cd1a99d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:45.905682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:45.921219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-3a371851-5a42-4e24-b000-e816cd1a99d0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:45.922409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3a371851-5a42-4e24-b000-e816cd1a99d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:45.987127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee58b9c-9fe1-4f9d-b115-c15f2bc2acb5 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:46.034482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 14/27] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:46.136074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee58b9c-9fe1-4f9d-b115-c15f2bc2acb5 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:46.153557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:46.181922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11227eac-1567-40d4-b519-6459efcdec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:46.182580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227eac-1567-40d4-b519-6459efcdec43 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.182887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227eac-1567-40d4-b519-6459efcdec43 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.183159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227eac-1567-40d4-b519-6459efcdec43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:46.195891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11227eac-1567-40d4-b519-6459efcdec43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-11227eac-1567-40d4-b519-6459efcdec43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:31:46.206489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:31:46.207456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:31:46.208207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 14/28] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:31:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:31:46.215725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a371851-5a42-4e24-b000-e816cd1a99d0 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:46.381424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11227eac-1567-40d4-b519-6459efcdec43 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:46.405736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a371851-5a42-4e24-b000-e816cd1a99d0 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:46.464730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b842ee-b55e-416a-b778-e0cce0c431bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:46.465316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b842ee-b55e-416a-b778-e0cce0c431bf None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.465553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b842ee-b55e-416a-b778-e0cce0c431bf None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.465824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b842ee-b55e-416a-b778-e0cce0c431bf None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:46.466604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b842ee-b55e-416a-b778-e0cce0c431bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:46.466942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b842ee-b55e-416a-b778-e0cce0c431bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:46.468346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b842ee-b55e-416a-b778-e0cce0c431bf None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:46.470587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:46.485287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 15/29] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:31:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:46.490981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b842ee-b55e-416a-b778-e0cce0c431bf None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:46.540818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11227eac-1567-40d4-b519-6459efcdec43 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:46.599758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc4ca6-a163-47b1-ad34-fb4dd08ad3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:46.600430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc4ca6-a163-47b1-ad34-fb4dd08ad3ab None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.600717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc4ca6-a163-47b1-ad34-fb4dd08ad3ab None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.600995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc4ca6-a163-47b1-ad34-fb4dd08ad3ab None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:46.601937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc4ca6-a163-47b1-ad34-fb4dd08ad3ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:46.603962 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc4ca6-a163-47b1-ad34-fb4dd08ad3ab None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:46.644192 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b842ee-b55e-416a-b778-e0cce0c431bf None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:46.681383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30c7e2-de77-4519-b11a-2fd7f336518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:46.682015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c7e2-de77-4519-b11a-2fd7f336518c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.682295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c7e2-de77-4519-b11a-2fd7f336518c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.682571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c7e2-de77-4519-b11a-2fd7f336518c None admin] PATH_INFO: `/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:46.683764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30c7e2-de77-4519-b11a-2fd7f336518c None admin] RBAC: Authorizing `identity:get_user(user_id=6889fd2ecc6c467f8af1a4d5c4e42fb5)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:46.685223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30c7e2-de77-4519-b11a-2fd7f336518c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:46.686933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 16/30] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:31:46 2022] GET /identity/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:31:46.687712 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30c7e2-de77-4519-b11a-2fd7f336518c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:46.761039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:46.764067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 15/31] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 11:31:46 2022] POST /identity/v3/roles => generated 219 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:31:46.765719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078bb3d-1ef5-4987-a8a9-7262e6ce9f7f None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.766011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078bb3d-1ef5-4987-a8a9-7262e6ce9f7f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.766288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078bb3d-1ef5-4987-a8a9-7262e6ce9f7f None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:46.768146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 16/32] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:46.768879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078bb3d-1ef5-4987-a8a9-7262e6ce9f7f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:46.839822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30c7e2-de77-4519-b11a-2fd7f336518c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:46.849238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:46.898418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09830aa-37cf-407b-8427-a350e9c9020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:46.899125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09830aa-37cf-407b-8427-a350e9c9020e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.899438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09830aa-37cf-407b-8427-a350e9c9020e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.899717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09830aa-37cf-407b-8427-a350e9c9020e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:46.914060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09830aa-37cf-407b-8427-a350e9c9020e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:46.915652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09830aa-37cf-407b-8427-a350e9c9020e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:46.943379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078bb3d-1ef5-4987-a8a9-7262e6ce9f7f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-b09830aa-37cf-407b-8427-a350e9c9020e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:31:46.944565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:31:46.945681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:31:46.946686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:31:46.946686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:31:46.946686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:31:46.946686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 17/33] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:31:46.952224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2447fd1-cedd-4602-a08c-52a2dfef9d68 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.952224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2447fd1-cedd-4602-a08c-52a2dfef9d68 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.952224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2447fd1-cedd-4602-a08c-52a2dfef9d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:46.970473 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a2447fd1-cedd-4602-a08c-52a2dfef9d68 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:46.971795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a2447fd1-cedd-4602-a08c-52a2dfef9d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:46.996973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4437-fd69-416c-bd62-1f781b4256af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:46.997954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4437-fd69-416c-bd62-1f781b4256af None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:46.998424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4437-fd69-416c-bd62-1f781b4256af None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:46.998937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4437-fd69-416c-bd62-1f781b4256af None admin] PATH_INFO: `/v3/domains/default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.000572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e4437-fd69-416c-bd62-1f781b4256af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:47.003294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e4437-fd69-416c-bd62-1f781b4256af None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:47.005181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 17/34] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:31:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:47.007538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e437284-5649-4646-bfd4-1b48b4df93fb None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.008271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e437284-5649-4646-bfd4-1b48b4df93fb None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.008723 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e437284-5649-4646-bfd4-1b48b4df93fb None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.010157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 18/35] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:47.011141 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e437284-5649-4646-bfd4-1b48b4df93fb None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:47.071680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 18/36] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:47.073330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448cb3e-2b85-4a7f-9ef6-dd69cdcdd999 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.073764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448cb3e-2b85-4a7f-9ef6-dd69cdcdd999 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.074252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448cb3e-2b85-4a7f-9ef6-dd69cdcdd999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.101939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6448cb3e-2b85-4a7f-9ef6-dd69cdcdd999 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:47.103176 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6448cb3e-2b85-4a7f-9ef6-dd69cdcdd999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:47.140093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e437284-5649-4646-bfd4-1b48b4df93fb None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:47.143379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:47.151771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:47.181393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 19/37] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:47.182389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448cb3e-2b85-4a7f-9ef6-dd69cdcdd999 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:47.182496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450b825-41ab-46b3-a48f-0233036d447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:47.183150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450b825-41ab-46b3-a48f-0233036d447e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.183445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450b825-41ab-46b3-a48f-0233036d447e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.183728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450b825-41ab-46b3-a48f-0233036d447e None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.184396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450b825-41ab-46b3-a48f-0233036d447e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:47.184714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450b825-41ab-46b3-a48f-0233036d447e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:47.186448 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450b825-41ab-46b3-a48f-0233036d447e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:47.200245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 19/38] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:47.211764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450b825-41ab-46b3-a48f-0233036d447e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:47.299228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448cb3e-2b85-4a7f-9ef6-dd69cdcdd999 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:47.337646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a760f59-2d80-485e-95d3-035c86488116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:47.338380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a760f59-2d80-485e-95d3-035c86488116 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.338667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a760f59-2d80-485e-95d3-035c86488116 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.338968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a760f59-2d80-485e-95d3-035c86488116 None admin] PATH_INFO: `/v3/domains/default/users/6889fd2ecc6c467f8af1a4d5c4e42fb5/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.341051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a760f59-2d80-485e-95d3-035c86488116 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6889fd2ecc6c467f8af1a4d5c4e42fb5, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:47.342621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a760f59-2d80-485e-95d3-035c86488116 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:47.372428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450b825-41ab-46b3-a48f-0233036d447e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:47.408471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175ca3-a4d2-4b74-8e23-4178c1cb6c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:47.409084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175ca3-a4d2-4b74-8e23-4178c1cb6c3f None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.409312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175ca3-a4d2-4b74-8e23-4178c1cb6c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.409539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175ca3-a4d2-4b74-8e23-4178c1cb6c3f None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.410188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175ca3-a4d2-4b74-8e23-4178c1cb6c3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:47.411672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175ca3-a4d2-4b74-8e23-4178c1cb6c3f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:47.442982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 20/39] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:31:47 2022] POST /identity/v3/projects => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:31:47.444564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375d97-f1f6-4bd0-817d-d5b3ca1eacbe None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.445066 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375d97-f1f6-4bd0-817d-d5b3ca1eacbe None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.445597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375d97-f1f6-4bd0-817d-d5b3ca1eacbe None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.447111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 21/40] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:47.448064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4375d97-f1f6-4bd0-817d-d5b3ca1eacbe None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:47.481144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 20/41] 10.222.0.59 () {58 vars in 1361 bytes} [Wed Aug 24 11:31:47 2022] PUT /identity/v3/domains/default/users/6889fd2ecc6c467f8af1a4d5c4e42fb5/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:31:47.483684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223ba8-84b8-4352-9994-63e6fbfa9535 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.484111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223ba8-84b8-4352-9994-63e6fbfa9535 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.484540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223ba8-84b8-4352-9994-63e6fbfa9535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.488579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:47.505925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-77223ba8-84b8-4352-9994-63e6fbfa9535 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:47.507836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-77223ba8-84b8-4352-9994-63e6fbfa9535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:47.547179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:47.590913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 21/42] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:47.592072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223ba8-84b8-4352-9994-63e6fbfa9535 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:47.613128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4375d97-f1f6-4bd0-817d-d5b3ca1eacbe None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:47.679809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560226f-e0eb-4483-b07c-d53d406cc30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:47.680632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560226f-e0eb-4483-b07c-d53d406cc30e None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.681016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560226f-e0eb-4483-b07c-d53d406cc30e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.681391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560226f-e0eb-4483-b07c-d53d406cc30e None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.682183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560226f-e0eb-4483-b07c-d53d406cc30e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:47.683919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560226f-e0eb-4483-b07c-d53d406cc30e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:47.703403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 22/43] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 11:31:47 2022] POST /identity/v3/roles => generated 225 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:31:47.820901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223ba8-84b8-4352-9994-63e6fbfa9535 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:47.871526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43c4af-583d-48b7-923f-430d5305d52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:47.872166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43c4af-583d-48b7-923f-430d5305d52d None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:47.872452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43c4af-583d-48b7-923f-430d5305d52d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:47.872733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43c4af-583d-48b7-923f-430d5305d52d None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:47.873417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43c4af-583d-48b7-923f-430d5305d52d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:47.875079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43c4af-583d-48b7-923f-430d5305d52d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:47.896969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 22/44] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 11:31:47 2022] POST /identity/v3/roles => generated 223 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:31:47.918853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560226f-e0eb-4483-b07c-d53d406cc30e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:48.028907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:48.060094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560226f-e0eb-4483-b07c-d53d406cc30e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:48.100368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47217c56-a346-4f4f-bc6d-0092fb6a0239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:48.101016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47217c56-a346-4f4f-bc6d-0092fb6a0239 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:48.101300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47217c56-a346-4f4f-bc6d-0092fb6a0239 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:48.101579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47217c56-a346-4f4f-bc6d-0092fb6a0239 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:48.102726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47217c56-a346-4f4f-bc6d-0092fb6a0239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:48.104223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47217c56-a346-4f4f-bc6d-0092fb6a0239 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:48.105814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 23/45] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:31:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:48.112169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43c4af-583d-48b7-923f-430d5305d52d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:48.140586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:48.216524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43c4af-583d-48b7-923f-430d5305d52d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:48.250904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e10f6d-88c0-403a-9e7f-7af2dd8567d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:48.251677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e10f6d-88c0-403a-9e7f-7af2dd8567d6 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:48.251962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e10f6d-88c0-403a-9e7f-7af2dd8567d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:48.252237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e10f6d-88c0-403a-9e7f-7af2dd8567d6 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:48.252886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e10f6d-88c0-403a-9e7f-7af2dd8567d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:48.254348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e10f6d-88c0-403a-9e7f-7af2dd8567d6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:48.287003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 23/46] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:31:48 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:31:49.616331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebc4ad-cfae-444f-91b3-299a665c41d1 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:49.616850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebc4ad-cfae-444f-91b3-299a665c41d1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:49.616955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebc4ad-cfae-444f-91b3-299a665c41d1 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:49.618306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 24/47] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:49.623710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63c743-cabc-4100-9650-bee8d2c321de None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:49.624144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63c743-cabc-4100-9650-bee8d2c321de None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:49.624277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63c743-cabc-4100-9650-bee8d2c321de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:49.644908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-af63c743-cabc-4100-9650-bee8d2c321de None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:49.646119 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-af63c743-cabc-4100-9650-bee8d2c321de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:49.714602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 24/48] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:49.993482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebc4ad-cfae-444f-91b3-299a665c41d1 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:50.098608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebc4ad-cfae-444f-91b3-299a665c41d1 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:50.132186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3edfb-3713-46d4-a90b-2f16842c3060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:50.132815 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3edfb-3713-46d4-a90b-2f16842c3060 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:50.133341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3edfb-3713-46d4-a90b-2f16842c3060 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:50.133621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3edfb-3713-46d4-a90b-2f16842c3060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:50.144794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3edfb-3713-46d4-a90b-2f16842c3060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-eaf3edfb-3713-46d4-a90b-2f16842c3060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:31:50.149563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:31:50.150668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:31:50.152110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 25/49] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:31:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:31:50.156543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63c743-cabc-4100-9650-bee8d2c321de None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:50.166731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:50.216441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292924f-4e61-4f76-ab1e-36916a00e0f5 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:50.216628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292924f-4e61-4f76-ab1e-36916a00e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:50.216904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292924f-4e61-4f76-ab1e-36916a00e0f5 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:50.218261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 26/50] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:31:50.224130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323769-a9e5-4938-b201-844801e448a2 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:50.224412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323769-a9e5-4938-b201-844801e448a2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:50.224802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323769-a9e5-4938-b201-844801e448a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:50.231869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:50.243502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-cb323769-a9e5-4938-b201-844801e448a2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:50.245057 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cb323769-a9e5-4938-b201-844801e448a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:50.261613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63c743-cabc-4100-9650-bee8d2c321de None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:50.295948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89ef24-1bf5-40c0-83d8-7cc47c5290bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:50.296571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89ef24-1bf5-40c0-83d8-7cc47c5290bb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:50.296855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89ef24-1bf5-40c0-83d8-7cc47c5290bb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:50.297133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89ef24-1bf5-40c0-83d8-7cc47c5290bb None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:50.297801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89ef24-1bf5-40c0-83d8-7cc47c5290bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:50.298112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89ef24-1bf5-40c0-83d8-7cc47c5290bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:50.300202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89ef24-1bf5-40c0-83d8-7cc47c5290bb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:50.308528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 25/51] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:31:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:50.314389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89ef24-1bf5-40c0-83d8-7cc47c5290bb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:50.317499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 27/52] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:31:50.384135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:50.417491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89ef24-1bf5-40c0-83d8-7cc47c5290bb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:50.453043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268501a-ff0b-455b-9b00-8e17d28adf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:50.453684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268501a-ff0b-455b-9b00-8e17d28adf86 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:50.453970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268501a-ff0b-455b-9b00-8e17d28adf86 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:50.454251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268501a-ff0b-455b-9b00-8e17d28adf86 None admin] PATH_INFO: `/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:50.455811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268501a-ff0b-455b-9b00-8e17d28adf86 None admin] RBAC: Authorizing `identity:get_user(user_id=6889fd2ecc6c467f8af1a4d5c4e42fb5)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:50.457264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268501a-ff0b-455b-9b00-8e17d28adf86 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:50.458897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:31:50 2022] GET /identity/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:31:50.464501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323769-a9e5-4938-b201-844801e448a2 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:50.572224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323769-a9e5-4938-b201-844801e448a2 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:50.584884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268501a-ff0b-455b-9b00-8e17d28adf86 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:50.607032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de92e9d-6512-441a-84e7-5a6fdf23167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:50.607673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de92e9d-6512-441a-84e7-5a6fdf23167c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:50.607957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de92e9d-6512-441a-84e7-5a6fdf23167c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:50.608230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de92e9d-6512-441a-84e7-5a6fdf23167c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:50.609341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de92e9d-6512-441a-84e7-5a6fdf23167c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:50.610857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de92e9d-6512-441a-84e7-5a6fdf23167c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:50.612597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 28/54] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:31:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:50.618463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de92e9d-6512-441a-84e7-5a6fdf23167c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:50.621824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:50.692478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268501a-ff0b-455b-9b00-8e17d28adf86 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:50.725274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de92e9d-6512-441a-84e7-5a6fdf23167c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:50.731122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536d424-0c35-48c8-af7d-d90f2b657d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:50.731767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536d424-0c35-48c8-af7d-d90f2b657d82 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:50.732049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536d424-0c35-48c8-af7d-d90f2b657d82 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:50.732324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536d424-0c35-48c8-af7d-d90f2b657d82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:50.733438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536d424-0c35-48c8-af7d-d90f2b657d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:50.734932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536d424-0c35-48c8-af7d-d90f2b657d82 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:50.738805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:31:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:31:50.742443 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536d424-0c35-48c8-af7d-d90f2b657d82 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:50.751985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:50.766334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266eb674-7e05-4833-b92a-a2b9806e7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:50.767507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266eb674-7e05-4833-b92a-a2b9806e7230 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:50.767789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266eb674-7e05-4833-b92a-a2b9806e7230 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:50.768060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266eb674-7e05-4833-b92a-a2b9806e7230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:50.768890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266eb674-7e05-4833-b92a-a2b9806e7230 None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.domain.id=default, user.id=6889fd2ecc6c467f8af1a4d5c4e42fb5) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:50.769196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266eb674-7e05-4833-b92a-a2b9806e7230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:50.770632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266eb674-7e05-4833-b92a-a2b9806e7230 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:50.779347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 29/56] 10.222.0.59 () {56 vars in 1322 bytes} [Wed Aug 24 11:31:50 2022] GET /identity/v3/role_assignments?user.id=6889fd2ecc6c467f8af1a4d5c4e42fb5&scope.domain.id=default&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:31:50.857195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536d424-0c35-48c8-af7d-d90f2b657d82 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:50.895235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef552f81-9612-4f53-9ef7-455c3ab78790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:50.895866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef552f81-9612-4f53-9ef7-455c3ab78790 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:50.896146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef552f81-9612-4f53-9ef7-455c3ab78790 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:50.896418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef552f81-9612-4f53-9ef7-455c3ab78790 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:50.897072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef552f81-9612-4f53-9ef7-455c3ab78790 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:50.898541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef552f81-9612-4f53-9ef7-455c3ab78790 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:50.928356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 28/57] 10.222.0.59 () {60 vars in 1140 bytes} [Wed Aug 24 11:31:50 2022] POST /identity/v3/projects => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:31:52.896346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d38fb4-3ba9-4d08-821a-d762c5789afc None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:52.896855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d38fb4-3ba9-4d08-821a-d762c5789afc None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:52.896940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d38fb4-3ba9-4d08-821a-d762c5789afc None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:52.898248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 30/58] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:52.903565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36f4f-b30c-4f10-8a87-97f09c22660b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:52.903963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36f4f-b30c-4f10-8a87-97f09c22660b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:52.904112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36f4f-b30c-4f10-8a87-97f09c22660b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:52.922150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a4d36f4f-b30c-4f10-8a87-97f09c22660b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:52.923544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a4d36f4f-b30c-4f10-8a87-97f09c22660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:52.976181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:52.990548 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 29/59] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:53.269272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d38fb4-3ba9-4d08-821a-d762c5789afc None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:53.336689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:53.373867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d38fb4-3ba9-4d08-821a-d762c5789afc None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:53.409676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbf946-4234-4ddb-b5fa-4537bba92a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:53.410315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf946-4234-4ddb-b5fa-4537bba92a9c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:53.410602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf946-4234-4ddb-b5fa-4537bba92a9c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:53.410912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf946-4234-4ddb-b5fa-4537bba92a9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:53.412107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbf946-4234-4ddb-b5fa-4537bba92a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:53.413785 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbf946-4234-4ddb-b5fa-4537bba92a9c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:53.415387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 31/60] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:31:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:53.421297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d36f4f-b30c-4f10-8a87-97f09c22660b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:53.527155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d36f4f-b30c-4f10-8a87-97f09c22660b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:53.561745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f5feb-9270-4628-bafa-2a32fa7b39ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:53.562354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5feb-9270-4628-bafa-2a32fa7b39ba None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:53.562641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5feb-9270-4628-bafa-2a32fa7b39ba None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:53.562950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5feb-9270-4628-bafa-2a32fa7b39ba None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:53.563600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f5feb-9270-4628-bafa-2a32fa7b39ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:53.565775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f5feb-9270-4628-bafa-2a32fa7b39ba None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:53.592999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 30/61] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:31:53 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:31:56.592758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f226-9018-46fa-b3a2-0bed6215d824 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:56.593289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f226-9018-46fa-b3a2-0bed6215d824 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:56.593289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f226-9018-46fa-b3a2-0bed6215d824 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:56.594647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 32/62] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:56.613262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ebe60-1b85-413f-9698-bba2207827ab None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:56.614109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ebe60-1b85-413f-9698-bba2207827ab None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:56.614567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ebe60-1b85-413f-9698-bba2207827ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:56.639806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-267ebe60-1b85-413f-9698-bba2207827ab None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:56.641309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-267ebe60-1b85-413f-9698-bba2207827ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:56.695731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:56.738036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 31/63] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:56.772738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff3b62-ce39-4e8a-bf38-7de5b3ef0785 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:56.773035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff3b62-ce39-4e8a-bf38-7de5b3ef0785 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:56.773299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff3b62-ce39-4e8a-bf38-7de5b3ef0785 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:56.774882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 33/64] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:56.780313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf10e2-92b8-44a5-ab21-9e7d9b2599e4 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:56.780619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf10e2-92b8-44a5-ab21-9e7d9b2599e4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:56.780909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf10e2-92b8-44a5-ab21-9e7d9b2599e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:56.806939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-82cf10e2-92b8-44a5-ab21-9e7d9b2599e4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:56.808178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-82cf10e2-92b8-44a5-ab21-9e7d9b2599e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:56.901410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 32/65] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:31:56.983107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad4f62-1a6a-4ef0-84a1-2caab254bef1 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:56.983707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad4f62-1a6a-4ef0-84a1-2caab254bef1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:56.984176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad4f62-1a6a-4ef0-84a1-2caab254bef1 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:56.985760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 34/66] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:56.991500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c97b5e-36ca-4575-b9c1-06b6dc9414a6 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:56.991797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c97b5e-36ca-4575-b9c1-06b6dc9414a6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:56.992092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c97b5e-36ca-4575-b9c1-06b6dc9414a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.021835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-61c97b5e-36ca-4575-b9c1-06b6dc9414a6 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:57.023175 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-61c97b5e-36ca-4575-b9c1-06b6dc9414a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:57.085595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2246b-56e7-43d9-beca-7be882d8ba47 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.086230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2246b-56e7-43d9-beca-7be882d8ba47 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.086698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2246b-56e7-43d9-beca-7be882d8ba47 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.088274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 35/67] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:57.093279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20120aa-699e-4455-b699-7b0fa36b23ab None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.093797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20120aa-699e-4455-b699-7b0fa36b23ab None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.094278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20120aa-699e-4455-b699-7b0fa36b23ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.114614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e20120aa-699e-4455-b699-7b0fa36b23ab None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:57.116199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e20120aa-699e-4455-b699-7b0fa36b23ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:57.121844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 33/68] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:57.122794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c97b5e-36ca-4575-b9c1-06b6dc9414a6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:57.159806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:57.212755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 36/69] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:31:57.221434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20120aa-699e-4455-b699-7b0fa36b23ab None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:57.276613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c97b5e-36ca-4575-b9c1-06b6dc9414a6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:57.352363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9d7b-7636-49a6-974c-edb4f688fa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:57.353021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9d7b-7636-49a6-974c-edb4f688fa39 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.353292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9d7b-7636-49a6-974c-edb4f688fa39 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.353571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9d7b-7636-49a6-974c-edb4f688fa39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.387927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e9d7b-7636-49a6-974c-edb4f688fa39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-f69e9d7b-7636-49a6-974c-edb4f688fa39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:31:57.393518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:31:57.394436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:31:57.395264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 34/70] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:31:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:31:57.403930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9d7b-7636-49a6-974c-edb4f688fa39 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:57.463232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:57.509173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20120aa-699e-4455-b699-7b0fa36b23ab None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:57.548370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:57.557160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9d7b-7636-49a6-974c-edb4f688fa39 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:57.559611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b6f32-e8de-4913-9be5-ac67cd82bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:57.560668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b6f32-e8de-4913-9be5-ac67cd82bd01 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.561154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b6f32-e8de-4913-9be5-ac67cd82bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.561637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b6f32-e8de-4913-9be5-ac67cd82bd01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.573542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b6f32-e8de-4913-9be5-ac67cd82bd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-1a7b6f32-e8de-4913-9be5-ac67cd82bd01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:31:57.578295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:31:57.579302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 37/71] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:31:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:31:57.581270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b6f32-e8de-4913-9be5-ac67cd82bd01 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:57.596780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ef5d4-d108-4014-ba99-68f865284221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:57.597406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ef5d4-d108-4014-ba99-68f865284221 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.597697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ef5d4-d108-4014-ba99-68f865284221 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.597979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ef5d4-d108-4014-ba99-68f865284221 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.598664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ef5d4-d108-4014-ba99-68f865284221 None admin] RBAC: Adding query filter params (name=member) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:57.599017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ef5d4-d108-4014-ba99-68f865284221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:57.600480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ef5d4-d108-4014-ba99-68f865284221 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:57.608831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 35/72] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:31:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:57.613846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d147d72-75c8-491e-832c-2d4242448724 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.613846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d147d72-75c8-491e-832c-2d4242448724 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.613846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d147d72-75c8-491e-832c-2d4242448724 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.613846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 36/73] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:31:57.613846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d147d72-75c8-491e-832c-2d4242448724 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:57.684884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b6f32-e8de-4913-9be5-ac67cd82bd01 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:57.710701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:57.720323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d147d72-75c8-491e-832c-2d4242448724 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:57.722441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d0013-a854-4a38-bdeb-38ab956a4471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:57.723114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d0013-a854-4a38-bdeb-38ab956a4471 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.723401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d0013-a854-4a38-bdeb-38ab956a4471 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.723684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d0013-a854-4a38-bdeb-38ab956a4471 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.734071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d0013-a854-4a38-bdeb-38ab956a4471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-022d0013-a854-4a38-bdeb-38ab956a4471 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:31:57.739386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:31:57.740379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 38/74] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:31:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:31:57.741273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d0013-a854-4a38-bdeb-38ab956a4471 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:57.766401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78226f-5c6b-40c0-8470-53653c6303c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:57.767683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78226f-5c6b-40c0-8470-53653c6303c7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.767966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78226f-5c6b-40c0-8470-53653c6303c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.768240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78226f-5c6b-40c0-8470-53653c6303c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.769363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78226f-5c6b-40c0-8470-53653c6303c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:57.770858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78226f-5c6b-40c0-8470-53653c6303c7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:57.772476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:31:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:57.775605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78226f-5c6b-40c0-8470-53653c6303c7 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:57.802167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:57.857412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d0013-a854-4a38-bdeb-38ab956a4471 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:57.890101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78226f-5c6b-40c0-8470-53653c6303c7 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:57.899504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9d901-dd96-4b4a-8bad-9d9cd3ed8457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:57.900096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d901-dd96-4b4a-8bad-9d9cd3ed8457 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.900378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d901-dd96-4b4a-8bad-9d9cd3ed8457 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.900652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d901-dd96-4b4a-8bad-9d9cd3ed8457 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.901309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9d901-dd96-4b4a-8bad-9d9cd3ed8457 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:57.901614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9d901-dd96-4b4a-8bad-9d9cd3ed8457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:57.903005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9d901-dd96-4b4a-8bad-9d9cd3ed8457 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:57.915105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 39/76] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:57.916340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec04c9-cb38-4e1d-bb8b-b7e0ca39630b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.916658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec04c9-cb38-4e1d-bb8b-b7e0ca39630b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.916936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec04c9-cb38-4e1d-bb8b-b7e0ca39630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.930729 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8067b-fa01-440d-8081-ab9f5b83f766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:57.931469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8067b-fa01-440d-8081-ab9f5b83f766 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:57.931751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8067b-fa01-440d-8081-ab9f5b83f766 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:57.932023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8067b-fa01-440d-8081-ab9f5b83f766 None admin] PATH_INFO: `/v3/users/ab79d473dce94574b1e4da104bc02e6b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:57.934255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d7ec04c9-cb38-4e1d-bb8b-b7e0ca39630b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:31:57.935510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d7ec04c9-cb38-4e1d-bb8b-b7e0ca39630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:31:57.946910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8067b-fa01-440d-8081-ab9f5b83f766 None admin] RBAC: Authorizing `identity:get_user(user_id=ab79d473dce94574b1e4da104bc02e6b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:57.948603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8067b-fa01-440d-8081-ab9f5b83f766 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:57.950464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 38/77] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:31:57 2022] GET /identity/v3/users/ab79d473dce94574b1e4da104bc02e6b => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:57.951271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8067b-fa01-440d-8081-ab9f5b83f766 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:57.984863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.012168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 40/78] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:31:58.012876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec04c9-cb38-4e1d-bb8b-b7e0ca39630b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:58.039280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.060364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8067b-fa01-440d-8081-ab9f5b83f766 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:58.097546 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65268710-1458-4cd3-9629-314e899fa9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:58.098156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65268710-1458-4cd3-9629-314e899fa9bc None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:58.098435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65268710-1458-4cd3-9629-314e899fa9bc None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:58.098718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65268710-1458-4cd3-9629-314e899fa9bc None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:58.099403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65268710-1458-4cd3-9629-314e899fa9bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:58.099720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65268710-1458-4cd3-9629-314e899fa9bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:58.101111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65268710-1458-4cd3-9629-314e899fa9bc None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:58.109351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 39/79] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:31:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:58.109351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65268710-1458-4cd3-9629-314e899fa9bc None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:58.124157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec04c9-cb38-4e1d-bb8b-b7e0ca39630b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:58.161264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3180e-f164-442d-9b5d-2ad306f7d797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:58.161877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3180e-f164-442d-9b5d-2ad306f7d797 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:58.162159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3180e-f164-442d-9b5d-2ad306f7d797 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:58.162429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3180e-f164-442d-9b5d-2ad306f7d797 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:58.163112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3180e-f164-442d-9b5d-2ad306f7d797 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:58.164564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3180e-f164-442d-9b5d-2ad306f7d797 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:58.202848 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 41/80] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:31:58 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:31:58.202848 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3180e-f164-442d-9b5d-2ad306f7d797 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:58.241143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65268710-1458-4cd3-9629-314e899fa9bc None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:58.244943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.285630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03ea2-ba87-4517-bc97-2021da517fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:58.286383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03ea2-ba87-4517-bc97-2021da517fda None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:58.286738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03ea2-ba87-4517-bc97-2021da517fda None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:58.287111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03ea2-ba87-4517-bc97-2021da517fda None admin] PATH_INFO: `/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:58.288465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03ea2-ba87-4517-bc97-2021da517fda None admin] RBAC: Authorizing `identity:get_user(user_id=6889fd2ecc6c467f8af1a4d5c4e42fb5)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:58.290283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03ea2-ba87-4517-bc97-2021da517fda None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:58.292286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 40/81] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:31:58 2022] GET /identity/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:58.293039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03ea2-ba87-4517-bc97-2021da517fda None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:58.310842 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.337765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3180e-f164-442d-9b5d-2ad306f7d797 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:58.384239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec445a-120c-4894-8c54-c69d26000da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:58.384859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec445a-120c-4894-8c54-c69d26000da1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:58.385143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec445a-120c-4894-8c54-c69d26000da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:58.385420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec445a-120c-4894-8c54-c69d26000da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:58.418970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03ea2-ba87-4517-bc97-2021da517fda None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:58.468269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f7a6-fe0f-4f4f-8ce5-4359ca23b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:58.468919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f7a6-fe0f-4f4f-8ce5-4359ca23b862 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:58.469209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f7a6-fe0f-4f4f-8ce5-4359ca23b862 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:58.469489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f7a6-fe0f-4f4f-8ce5-4359ca23b862 None admin] PATH_INFO: `/v3/users/ab79d473dce94574b1e4da104bc02e6b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:58.471469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8f7a6-fe0f-4f4f-8ce5-4359ca23b862 None admin] RBAC: Authorizing `identity:get_user(user_id=ab79d473dce94574b1e4da104bc02e6b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:58.472946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8f7a6-fe0f-4f4f-8ce5-4359ca23b862 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:58.474797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 41/82] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:31:58 2022] GET /identity/v3/users/ab79d473dce94574b1e4da104bc02e6b => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:58.475887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec445a-120c-4894-8c54-c69d26000da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:58.476212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f7a6-fe0f-4f4f-8ce5-4359ca23b862 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:58.477781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec445a-120c-4894-8c54-c69d26000da1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:58.527236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.583898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.609469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 42/83] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:58.610333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec445a-120c-4894-8c54-c69d26000da1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:58.615489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f7a6-fe0f-4f4f-8ce5-4359ca23b862 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:58.658985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d288d71-ddb8-46f9-9d0a-0c7e7418e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:58.659584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d288d71-ddb8-46f9-9d0a-0c7e7418e32a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:58.659868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d288d71-ddb8-46f9-9d0a-0c7e7418e32a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:58.660141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d288d71-ddb8-46f9-9d0a-0c7e7418e32a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:58.741376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec445a-120c-4894-8c54-c69d26000da1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:58.756019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d288d71-ddb8-46f9-9d0a-0c7e7418e32a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:58.758134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d288d71-ddb8-46f9-9d0a-0c7e7418e32a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:58.782328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.790965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060430f-be80-4a6a-8b5f-1a6c0314965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:58.792057 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060430f-be80-4a6a-8b5f-1a6c0314965a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:58.792858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060430f-be80-4a6a-8b5f-1a6c0314965a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:58.793591 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060430f-be80-4a6a-8b5f-1a6c0314965a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:58.808268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060430f-be80-4a6a-8b5f-1a6c0314965a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-0060430f-be80-4a6a-8b5f-1a6c0314965a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:31:58.816034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:31:58.816922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:31:58.817688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:31:58.820485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 43/84] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:31:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:31:58.821826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060430f-be80-4a6a-8b5f-1a6c0314965a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:58.874668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.907660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 42/85] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:58.913256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d288d71-ddb8-46f9-9d0a-0c7e7418e32a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:58.971952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060430f-be80-4a6a-8b5f-1a6c0314965a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:59.015486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b703936-1638-411f-92ba-04c562df0b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:59.016493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703936-1638-411f-92ba-04c562df0b46 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:59.016923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703936-1638-411f-92ba-04c562df0b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:59.018184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703936-1638-411f-92ba-04c562df0b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:59.044187 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d288d71-ddb8-46f9-9d0a-0c7e7418e32a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:59.084930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b1a0f-43bf-4ae4-ae8c-d1e86a0ccbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:59.085865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b1a0f-43bf-4ae4-ae8c-d1e86a0ccbfc None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:59.086320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b1a0f-43bf-4ae4-ae8c-d1e86a0ccbfc None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:59.086815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b1a0f-43bf-4ae4-ae8c-d1e86a0ccbfc None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:59.088269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b1a0f-43bf-4ae4-ae8c-d1e86a0ccbfc None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:59.088714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:59.091137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b1a0f-43bf-4ae4-ae8c-d1e86a0ccbfc None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:59.093221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 43/86] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:31:58 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:59.094199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b1a0f-43bf-4ae4-ae8c-d1e86a0ccbfc None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:59.105402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b703936-1638-411f-92ba-04c562df0b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:59.107081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b703936-1638-411f-92ba-04c562df0b46 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:59.149922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:59.211080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b1a0f-43bf-4ae4-ae8c-d1e86a0ccbfc None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:59.221937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 44/87] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:59.223071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b703936-1638-411f-92ba-04c562df0b46 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:59.251002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52519d-4995-493f-8358-eacfa0d2c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:59.252635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52519d-4995-493f-8358-eacfa0d2c860 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:59.253375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52519d-4995-493f-8358-eacfa0d2c860 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:59.253892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52519d-4995-493f-8358-eacfa0d2c860 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:59.254861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52519d-4995-493f-8358-eacfa0d2c860 None admin] RBAC: Adding query filter params (name=member) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:59.255344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52519d-4995-493f-8358-eacfa0d2c860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:59.257057 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52519d-4995-493f-8358-eacfa0d2c860 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:59.267311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 44/88] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:31:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:59.268754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52519d-4995-493f-8358-eacfa0d2c860 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:59.330366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:59.341132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b703936-1638-411f-92ba-04c562df0b46 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:59.380802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8522c-0ae8-468b-82cc-64f81c672116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:59.381456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8522c-0ae8-468b-82cc-64f81c672116 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:59.381740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8522c-0ae8-468b-82cc-64f81c672116 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:59.382016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8522c-0ae8-468b-82cc-64f81c672116 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:59.383735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8522c-0ae8-468b-82cc-64f81c672116 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:59.385445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8522c-0ae8-468b-82cc-64f81c672116 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:59.392210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 45/89] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:31:59 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:59.392210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8522c-0ae8-468b-82cc-64f81c672116 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:59.394748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52519d-4995-493f-8358-eacfa0d2c860 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:59.411841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:59.443703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbb5b7-c417-4585-a38e-08ad6f40a78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:59.445031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbb5b7-c417-4585-a38e-08ad6f40a78d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:59.445779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbb5b7-c417-4585-a38e-08ad6f40a78d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:59.446393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbb5b7-c417-4585-a38e-08ad6f40a78d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:59.447911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbb5b7-c417-4585-a38e-08ad6f40a78d None admin] RBAC: Adding query filter params (role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=b0de385b20724662bfc182dd6a4c2641, user.id=ab79d473dce94574b1e4da104bc02e6b) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:59.448377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbb5b7-c417-4585-a38e-08ad6f40a78d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:59.449975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbb5b7-c417-4585-a38e-08ad6f40a78d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:59.460511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 45/90] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:31:59 2022] GET /identity/v3/role_assignments?user.id=ab79d473dce94574b1e4da104bc02e6b&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:59.461346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbb5b7-c417-4585-a38e-08ad6f40a78d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:59.527399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8522c-0ae8-468b-82cc-64f81c672116 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:59.582450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d684b0-6e03-4375-9f07-e822fb17e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:59.583527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d684b0-6e03-4375-9f07-e822fb17e532 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:59.583958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d684b0-6e03-4375-9f07-e822fb17e532 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:59.584403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d684b0-6e03-4375-9f07-e822fb17e532 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:59.585805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d684b0-6e03-4375-9f07-e822fb17e532 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:59.587755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d684b0-6e03-4375-9f07-e822fb17e532 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:59.590241 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 46/91] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:31:59 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:59.591830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d684b0-6e03-4375-9f07-e822fb17e532 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:59.628786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:59.643057 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbb5b7-c417-4585-a38e-08ad6f40a78d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:59.724746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d684b0-6e03-4375-9f07-e822fb17e532 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:59.737911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d657ce-1c7e-4ea1-aaff-85925bfb4e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:59.738552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d657ce-1c7e-4ea1-aaff-85925bfb4e06 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:59.738880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d657ce-1c7e-4ea1-aaff-85925bfb4e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:59.739172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d657ce-1c7e-4ea1-aaff-85925bfb4e06 None admin] PATH_INFO: `/v3/users/ab79d473dce94574b1e4da104bc02e6b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:59.740312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d657ce-1c7e-4ea1-aaff-85925bfb4e06 None admin] RBAC: Authorizing `identity:get_user(user_id=ab79d473dce94574b1e4da104bc02e6b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:59.741874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d657ce-1c7e-4ea1-aaff-85925bfb4e06 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:59.743511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 46/92] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:31:59 2022] GET /identity/v3/users/ab79d473dce94574b1e4da104bc02e6b => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:59.748897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d657ce-1c7e-4ea1-aaff-85925bfb4e06 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:59.769611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7946c-eae9-4490-a1ce-0c6c0d945be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:59.771082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7946c-eae9-4490-a1ce-0c6c0d945be4 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:59.771512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7946c-eae9-4490-a1ce-0c6c0d945be4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:59.772171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7946c-eae9-4490-a1ce-0c6c0d945be4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:31:59.773468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7946c-eae9-4490-a1ce-0c6c0d945be4 None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=b0de385b20724662bfc182dd6a4c2641, user.id=6889fd2ecc6c467f8af1a4d5c4e42fb5) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:31:59.773927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7946c-eae9-4490-a1ce-0c6c0d945be4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:31:59.775540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7946c-eae9-4490-a1ce-0c6c0d945be4 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:31:59.784117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 47/93] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:31:59 2022] GET /identity/v3/role_assignments?user.id=6889fd2ecc6c467f8af1a4d5c4e42fb5&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:31:59.785146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7946c-eae9-4490-a1ce-0c6c0d945be4 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:31:59.819645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:59.924077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:59.936750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7946c-eae9-4490-a1ce-0c6c0d945be4 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:31:59.983388 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eba554-87f3-4d27-9aa8-f148051f3d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:31:59.984740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba554-87f3-4d27-9aa8-f148051f3d31 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:31:59.985034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba554-87f3-4d27-9aa8-f148051f3d31 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:31:59.985313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba554-87f3-4d27-9aa8-f148051f3d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:00.001164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d657ce-1c7e-4ea1-aaff-85925bfb4e06 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:00.076955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eba554-87f3-4d27-9aa8-f148051f3d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:00.078609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eba554-87f3-4d27-9aa8-f148051f3d31 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:00.100563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194818f-31d8-4eb0-85fc-d48bd900ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:00.101535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194818f-31d8-4eb0-85fc-d48bd900ce36 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:00.102013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194818f-31d8-4eb0-85fc-d48bd900ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:00.102581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194818f-31d8-4eb0-85fc-d48bd900ce36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:00.103538 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194818f-31d8-4eb0-85fc-d48bd900ce36 None admin] RBAC: Adding query filter params (role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=b0de385b20724662bfc182dd6a4c2641, user.id=ab79d473dce94574b1e4da104bc02e6b) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:00.104080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194818f-31d8-4eb0-85fc-d48bd900ce36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:00.105756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194818f-31d8-4eb0-85fc-d48bd900ce36 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:00.122147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 47/94] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:31:59 2022] GET /identity/v3/role_assignments?user.id=ab79d473dce94574b1e4da104bc02e6b&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=40201003f53c4077b8e412e7d4450cab => generated 259 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:00.187403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:00.199291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 48/95] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:00.205206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194818f-31d8-4eb0-85fc-d48bd900ce36 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:00.358933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194818f-31d8-4eb0-85fc-d48bd900ce36 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:00.367806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:00.403256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5951c-06eb-49ad-8201-a2417c4537cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:00.403916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5951c-06eb-49ad-8201-a2417c4537cc None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:00.404203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5951c-06eb-49ad-8201-a2417c4537cc None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:00.404484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5951c-06eb-49ad-8201-a2417c4537cc None admin] PATH_INFO: `/v3/projects/489c81caedde4f28b2a0fd979567a03e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:00.411597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5951c-06eb-49ad-8201-a2417c4537cc None admin] RBAC: Authorizing `identity:get_project(project_id=489c81caedde4f28b2a0fd979567a03e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:00.413104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5951c-06eb-49ad-8201-a2417c4537cc None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:00.414894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 48/96] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:00 2022] GET /identity/v3/projects/489c81caedde4f28b2a0fd979567a03e => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:00.421114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eba554-87f3-4d27-9aa8-f148051f3d31 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:00.593993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eba554-87f3-4d27-9aa8-f148051f3d31 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:00.615046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec43ed6-e791-42b2-854d-598b3abf1266 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:00.615470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec43ed6-e791-42b2-854d-598b3abf1266 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:00.615626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec43ed6-e791-42b2-854d-598b3abf1266 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:00.617311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 49/97] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:00.628291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582f9e7-ede8-4dde-966f-54b6022a1ea0 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:00.628631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582f9e7-ede8-4dde-966f-54b6022a1ea0 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:00.628864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582f9e7-ede8-4dde-966f-54b6022a1ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:00.635216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567eb8-70b5-496f-8e5f-63077e1e075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:00.635858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567eb8-70b5-496f-8e5f-63077e1e075a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:00.636140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567eb8-70b5-496f-8e5f-63077e1e075a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:00.636414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567eb8-70b5-496f-8e5f-63077e1e075a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:00.637239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567eb8-70b5-496f-8e5f-63077e1e075a None admin] RBAC: Adding query filter params (role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=489c81caedde4f28b2a0fd979567a03e, user.id=ab79d473dce94574b1e4da104bc02e6b) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:00.637616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567eb8-70b5-496f-8e5f-63077e1e075a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:00.639495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567eb8-70b5-496f-8e5f-63077e1e075a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:00.649459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 49/98] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:00 2022] GET /identity/v3/role_assignments?user.id=ab79d473dce94574b1e4da104bc02e6b&scope.project.id=489c81caedde4f28b2a0fd979567a03e&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:00.680065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9582f9e7-ede8-4dde-966f-54b6022a1ea0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:00.681332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9582f9e7-ede8-4dde-966f-54b6022a1ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:00.820983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 50/99] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:00.862186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888254f7-60e1-40cf-bfcd-2262496a9cdb None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:00.862669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888254f7-60e1-40cf-bfcd-2262496a9cdb None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:00.862757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888254f7-60e1-40cf-bfcd-2262496a9cdb None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:00.864486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 50/100] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:00.870255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce864-52e2-498a-a8a1-433a982d8593 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:00.870612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce864-52e2-498a-a8a1-433a982d8593 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:00.871015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce864-52e2-498a-a8a1-433a982d8593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:00.900141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-dc2ce864-52e2-498a-a8a1-433a982d8593 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:00.901431 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dc2ce864-52e2-498a-a8a1-433a982d8593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:01.000657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 51/101] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:01.274470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888254f7-60e1-40cf-bfcd-2262496a9cdb None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:01.340668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:01.389502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888254f7-60e1-40cf-bfcd-2262496a9cdb None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:01.425436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0c60c-4def-478c-b5dc-a62db5d922e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:01.426052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0c60c-4def-478c-b5dc-a62db5d922e8 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:01.426330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0c60c-4def-478c-b5dc-a62db5d922e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:01.426602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0c60c-4def-478c-b5dc-a62db5d922e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:01.437864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0c60c-4def-478c-b5dc-a62db5d922e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-e9e0c60c-4def-478c-b5dc-a62db5d922e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:01.443900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:01.444783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:01.445637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 51/102] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:01.456334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce864-52e2-498a-a8a1-433a982d8593 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:01.491867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0c60c-4def-478c-b5dc-a62db5d922e8 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:01.507561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:01.596106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce864-52e2-498a-a8a1-433a982d8593 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:01.661249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0c60c-4def-478c-b5dc-a62db5d922e8 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:01.675675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ace5b-6b3e-413c-872a-5632ee6ac26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:01.676595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ace5b-6b3e-413c-872a-5632ee6ac26a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:01.676886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ace5b-6b3e-413c-872a-5632ee6ac26a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:01.677165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ace5b-6b3e-413c-872a-5632ee6ac26a None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:01.677844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ace5b-6b3e-413c-872a-5632ee6ac26a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:01.678972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ace5b-6b3e-413c-872a-5632ee6ac26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:01.682309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ace5b-6b3e-413c-872a-5632ee6ac26a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:01.695907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:01.703748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 52/103] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:01.712475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ace5b-6b3e-413c-872a-5632ee6ac26a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:01.734364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cd319-41bc-488d-bb93-229b47e8a9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:01.735038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cd319-41bc-488d-bb93-229b47e8a9f4 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:01.735328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cd319-41bc-488d-bb93-229b47e8a9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:01.735609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cd319-41bc-488d-bb93-229b47e8a9f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:01.737447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cd319-41bc-488d-bb93-229b47e8a9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:01.739739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cd319-41bc-488d-bb93-229b47e8a9f4 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:01.742941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 52/104] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:01.747450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cd319-41bc-488d-bb93-229b47e8a9f4 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:01.888062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:01.895686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ace5b-6b3e-413c-872a-5632ee6ac26a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:01.926858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cd319-41bc-488d-bb93-229b47e8a9f4 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:01.950650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0d48-ef5c-4a28-8aad-aed620d97f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:01.951336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0d48-ef5c-4a28-8aad-aed620d97f63 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:01.951619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0d48-ef5c-4a28-8aad-aed620d97f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:01.951897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0d48-ef5c-4a28-8aad-aed620d97f63 None admin] PATH_INFO: `/v3/users/943ef6b09f6840ed8c7596959f7c2ac3` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:01.968380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0d48-ef5c-4a28-8aad-aed620d97f63 None admin] RBAC: Authorizing `identity:get_user(user_id=943ef6b09f6840ed8c7596959f7c2ac3)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:01.970011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0d48-ef5c-4a28-8aad-aed620d97f63 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:01.972338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 53/105] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:01 2022] GET /identity/v3/users/943ef6b09f6840ed8c7596959f7c2ac3 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:01.977906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0d48-ef5c-4a28-8aad-aed620d97f63 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:01.983101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5b7b-ecf6-42b8-b4bd-f0e4bac8b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:01.983993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5b7b-ecf6-42b8-b4bd-f0e4bac8b234 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:01.984486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5b7b-ecf6-42b8-b4bd-f0e4bac8b234 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:01.984967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5b7b-ecf6-42b8-b4bd-f0e4bac8b234 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:01.985954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc5b7b-ecf6-42b8-b4bd-f0e4bac8b234 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:01.988418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc5b7b-ecf6-42b8-b4bd-f0e4bac8b234 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:02.026354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 53/106] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:32:01 2022] POST /identity/v3/projects => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:02.100665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0d48-ef5c-4a28-8aad-aed620d97f63 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:02.146741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b9327-afc9-4ab9-ac02-aaa689506507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:02.147330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b9327-afc9-4ab9-ac02-aaa689506507 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:02.147614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b9327-afc9-4ab9-ac02-aaa689506507 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:02.147888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b9327-afc9-4ab9-ac02-aaa689506507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:02.183160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:02.249458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b9327-afc9-4ab9-ac02-aaa689506507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:02.251141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b9327-afc9-4ab9-ac02-aaa689506507 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:02.391148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 54/107] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:02.397271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5b7b-ecf6-42b8-b4bd-f0e4bac8b234 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:02.443663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:02.518165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5b7b-ecf6-42b8-b4bd-f0e4bac8b234 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:02.556857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b9096-fd29-46cb-a2a0-67ffc1a89fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:02.557518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9096-fd29-46cb-a2a0-67ffc1a89fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:02.557805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9096-fd29-46cb-a2a0-67ffc1a89fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:02.558085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9096-fd29-46cb-a2a0-67ffc1a89fd0 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:02.559360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b9096-fd29-46cb-a2a0-67ffc1a89fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:02.560834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b9096-fd29-46cb-a2a0-67ffc1a89fd0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:02.562493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 54/108] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:02 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:02.569291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b9327-afc9-4ab9-ac02-aaa689506507 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:02.650532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:02.699818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b9327-afc9-4ab9-ac02-aaa689506507 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:02.737843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e4fb9-2393-4d1f-8d15-3c72bf8af7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:02.738454 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e4fb9-2393-4d1f-8d15-3c72bf8af7d2 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:02.738733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e4fb9-2393-4d1f-8d15-3c72bf8af7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:02.739048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e4fb9-2393-4d1f-8d15-3c72bf8af7d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:02.739784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e4fb9-2393-4d1f-8d15-3c72bf8af7d2 None admin] RBAC: Adding query filter params (role.id=fcc7d8db3d7249f393782c75305077c2, scope.project.id=b0de385b20724662bfc182dd6a4c2641, user.id=943ef6b09f6840ed8c7596959f7c2ac3) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:02.740099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e4fb9-2393-4d1f-8d15-3c72bf8af7d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:02.741552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e4fb9-2393-4d1f-8d15-3c72bf8af7d2 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:02.747781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 55/109] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:02 2022] GET /identity/v3/role_assignments?user.id=943ef6b09f6840ed8c7596959f7c2ac3&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=fcc7d8db3d7249f393782c75305077c2 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:02.855543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c045-ae6e-4550-8049-0283f3d061c3 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:02.855862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c045-ae6e-4550-8049-0283f3d061c3 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:02.856100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c045-ae6e-4550-8049-0283f3d061c3 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:02.857501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 55/110] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:02.864006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933580f3-9214-4b25-8957-de1d2ec3475e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:02.864292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933580f3-9214-4b25-8957-de1d2ec3475e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:02.864575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933580f3-9214-4b25-8957-de1d2ec3475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:02.889734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-933580f3-9214-4b25-8957-de1d2ec3475e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:02.890978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-933580f3-9214-4b25-8957-de1d2ec3475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:02.989278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 56/111] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:03.012042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacabe3-3da7-4569-936c-b90d8bdc682e None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:03.012522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacabe3-3da7-4569-936c-b90d8bdc682e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:03.012593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacabe3-3da7-4569-936c-b90d8bdc682e None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:03.014087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 56/112] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:03.020397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3f75a-6fc2-4586-973b-a69f8eec06b8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:03.020699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3f75a-6fc2-4586-973b-a69f8eec06b8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:03.020991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3f75a-6fc2-4586-973b-a69f8eec06b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:03.050271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6be3f75a-6fc2-4586-973b-a69f8eec06b8 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:03.051527 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6be3f75a-6fc2-4586-973b-a69f8eec06b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:03.115321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:03.157160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 57/113] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:03.209286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af3807-9d4a-4bc3-97d8-020d4820e3da None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:03.209884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af3807-9d4a-4bc3-97d8-020d4820e3da None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:03.210358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af3807-9d4a-4bc3-97d8-020d4820e3da None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:03.212235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 57/114] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:03.217302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ea728-42bd-4bae-9de7-e82a402f0fd5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:03.217591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ea728-42bd-4bae-9de7-e82a402f0fd5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:03.217870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ea728-42bd-4bae-9de7-e82a402f0fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:03.247850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-789ea728-42bd-4bae-9de7-e82a402f0fd5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:03.249062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-789ea728-42bd-4bae-9de7-e82a402f0fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:03.335441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 58/115] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:03.545432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af3807-9d4a-4bc3-97d8-020d4820e3da None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:03.585234 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2604a1-c067-4ae0-a353-bc1263c922e8 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:03.585544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2604a1-c067-4ae0-a353-bc1263c922e8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:03.585797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2604a1-c067-4ae0-a353-bc1263c922e8 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:03.589845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 59/116] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:32:03.592989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974285-8d11-4d25-aea3-d1679e8105a3 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:03.593279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974285-8d11-4d25-aea3-d1679e8105a3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:03.593566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974285-8d11-4d25-aea3-d1679e8105a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:03.623492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-74974285-8d11-4d25-aea3-d1679e8105a3 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:03.624689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-74974285-8d11-4d25-aea3-d1679e8105a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:03.699469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af3807-9d4a-4bc3-97d8-020d4820e3da None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:03.703470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:03.756155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 60/117] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:03.757086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974285-8d11-4d25-aea3-d1679e8105a3 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:03.775844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1d006-11b8-47d3-910f-356e44694564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:03.776492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1d006-11b8-47d3-910f-356e44694564 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:03.776773 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1d006-11b8-47d3-910f-356e44694564 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:03.777043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1d006-11b8-47d3-910f-356e44694564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:03.796221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1d006-11b8-47d3-910f-356e44694564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-37d1d006-11b8-47d3-910f-356e44694564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:03.801750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:03.802611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:03.803421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 58/118] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:32:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:03.804043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1d006-11b8-47d3-910f-356e44694564 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:03.823476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:03.890639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974285-8d11-4d25-aea3-d1679e8105a3 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:03.916696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1d006-11b8-47d3-910f-356e44694564 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:03.946996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f9aa0-8b1b-405a-8c61-5a640fffeb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:03.947685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f9aa0-8b1b-405a-8c61-5a640fffeb9b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:03.948049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f9aa0-8b1b-405a-8c61-5a640fffeb9b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:03.948330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f9aa0-8b1b-405a-8c61-5a640fffeb9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:03.953362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49c3a-cc00-4a71-8a60-24eef5bbee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:03.954119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49c3a-cc00-4a71-8a60-24eef5bbee77 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:03.954534 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49c3a-cc00-4a71-8a60-24eef5bbee77 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:03.955421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f49c3a-cc00-4a71-8a60-24eef5bbee77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:03.965835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f49c3a-cc00-4a71-8a60-24eef5bbee77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-48f49c3a-cc00-4a71-8a60-24eef5bbee77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:03.971595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:03.972477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:03.973226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:03.973806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f9aa0-8b1b-405a-8c61-5a640fffeb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:03.973882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 59/119] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:03.973882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49c3a-cc00-4a71-8a60-24eef5bbee77 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-813f9aa0-8b1b-405a-8c61-5a640fffeb9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:03.977810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:03.978666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:03.979447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 61/120] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:03.980065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f9aa0-8b1b-405a-8c61-5a640fffeb9b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.007196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:04.112729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f49c3a-cc00-4a71-8a60-24eef5bbee77 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.129536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:04.135478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f9aa0-8b1b-405a-8c61-5a640fffeb9b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.156409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b85e32-e7dd-4db8-b313-f9c356b696e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.157292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85e32-e7dd-4db8-b313-f9c356b696e0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.158345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85e32-e7dd-4db8-b313-f9c356b696e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.158901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85e32-e7dd-4db8-b313-f9c356b696e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.160177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b85e32-e7dd-4db8-b313-f9c356b696e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:04.160911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b85e32-e7dd-4db8-b313-f9c356b696e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:04.162809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b85e32-e7dd-4db8-b313-f9c356b696e0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:04.174088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73d2b4-a9a3-4e86-9c9e-98132d8252a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.174375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 60/121] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:04.175347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b85e32-e7dd-4db8-b313-f9c356b696e0 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.175977 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73d2b4-a9a3-4e86-9c9e-98132d8252a3 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.176487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73d2b4-a9a3-4e86-9c9e-98132d8252a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.176994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73d2b4-a9a3-4e86-9c9e-98132d8252a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.177911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73d2b4-a9a3-4e86-9c9e-98132d8252a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:04.178424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73d2b4-a9a3-4e86-9c9e-98132d8252a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:04.180260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73d2b4-a9a3-4e86-9c9e-98132d8252a3 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:04.194942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 62/122] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:04.195873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73d2b4-a9a3-4e86-9c9e-98132d8252a3 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.293347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:04.314171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b85e32-e7dd-4db8-b313-f9c356b696e0 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.320937 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73d2b4-a9a3-4e86-9c9e-98132d8252a3 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.359772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64854e87-b7fc-4001-8ca6-4fc1a813d17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.360442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64854e87-b7fc-4001-8ca6-4fc1a813d17c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.360725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7a908-3bf6-4c1f-ad93-03875e9c8527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.360837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64854e87-b7fc-4001-8ca6-4fc1a813d17c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.361073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64854e87-b7fc-4001-8ca6-4fc1a813d17c None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.361846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7a908-3bf6-4c1f-ad93-03875e9c8527 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.361947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64854e87-b7fc-4001-8ca6-4fc1a813d17c None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:04.362246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64854e87-b7fc-4001-8ca6-4fc1a813d17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:04.362609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7a908-3bf6-4c1f-ad93-03875e9c8527 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.363143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7a908-3bf6-4c1f-ad93-03875e9c8527 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.363731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64854e87-b7fc-4001-8ca6-4fc1a813d17c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:04.378844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 61/123] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:04.378844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64854e87-b7fc-4001-8ca6-4fc1a813d17c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.380456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7a908-3bf6-4c1f-ad93-03875e9c8527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-28d7a908-3bf6-4c1f-ad93-03875e9c8527 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:04.388645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:04.389558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:04.390302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:04.393336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 63/124] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:04.394395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7a908-3bf6-4c1f-ad93-03875e9c8527 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.421468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:04.513025 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7a908-3bf6-4c1f-ad93-03875e9c8527 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.518996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64854e87-b7fc-4001-8ca6-4fc1a813d17c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.550136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72d90-b266-4af3-ade9-9fbe272bd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.551168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72d90-b266-4af3-ade9-9fbe272bd881 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.551673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72d90-b266-4af3-ade9-9fbe272bd881 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.552142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72d90-b266-4af3-ade9-9fbe272bd881 None admin] PATH_INFO: `/v3/users/ab79d473dce94574b1e4da104bc02e6b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.553473 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72d90-b266-4af3-ade9-9fbe272bd881 None admin] RBAC: Authorizing `identity:get_user(user_id=ab79d473dce94574b1e4da104bc02e6b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:04.555170 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72d90-b266-4af3-ade9-9fbe272bd881 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:04.556966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 64/125] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/users/ab79d473dce94574b1e4da104bc02e6b => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:04.558118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72d90-b266-4af3-ade9-9fbe272bd881 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.568458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db10220-4fcf-4d2d-b4d1-992992c7a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.569173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db10220-4fcf-4d2d-b4d1-992992c7a5f8 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.569459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db10220-4fcf-4d2d-b4d1-992992c7a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.569736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db10220-4fcf-4d2d-b4d1-992992c7a5f8 None admin] PATH_INFO: `/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.571978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db10220-4fcf-4d2d-b4d1-992992c7a5f8 None admin] RBAC: Authorizing `identity:get_user(user_id=6889fd2ecc6c467f8af1a4d5c4e42fb5)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:04.573971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db10220-4fcf-4d2d-b4d1-992992c7a5f8 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:04.576391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 62/126] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:04.577177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db10220-4fcf-4d2d-b4d1-992992c7a5f8 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.603318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:04.676618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:04.698726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72d90-b266-4af3-ade9-9fbe272bd881 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.741718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db10220-4fcf-4d2d-b4d1-992992c7a5f8 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.745506 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b7f10-2a6d-46e1-aa5e-9c384270b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.746167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b7f10-2a6d-46e1-aa5e-9c384270b495 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.746457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b7f10-2a6d-46e1-aa5e-9c384270b495 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.746734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b7f10-2a6d-46e1-aa5e-9c384270b495 None admin] PATH_INFO: `/v3/users/ab79d473dce94574b1e4da104bc02e6b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.747933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b7f10-2a6d-46e1-aa5e-9c384270b495 None admin] RBAC: Authorizing `identity:get_user(user_id=ab79d473dce94574b1e4da104bc02e6b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:04.749549 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b7f10-2a6d-46e1-aa5e-9c384270b495 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:04.756410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 65/127] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/users/ab79d473dce94574b1e4da104bc02e6b => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:04.756410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b7f10-2a6d-46e1-aa5e-9c384270b495 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.792143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e179f-aaed-4dce-801d-9bc5854eb83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.793214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e179f-aaed-4dce-801d-9bc5854eb83f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.793724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e179f-aaed-4dce-801d-9bc5854eb83f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.794197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e179f-aaed-4dce-801d-9bc5854eb83f None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.795133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e179f-aaed-4dce-801d-9bc5854eb83f None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:04.795656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e179f-aaed-4dce-801d-9bc5854eb83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:04.797384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e179f-aaed-4dce-801d-9bc5854eb83f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:04.810553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 63/128] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:04.812085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e179f-aaed-4dce-801d-9bc5854eb83f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.881741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b7f10-2a6d-46e1-aa5e-9c384270b495 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.920257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df52ce1-2b5f-4d3e-b568-53c5040feb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.920577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:04.921719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df52ce1-2b5f-4d3e-b568-53c5040feb03 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.922495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df52ce1-2b5f-4d3e-b568-53c5040feb03 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.922828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df52ce1-2b5f-4d3e-b568-53c5040feb03 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.925090 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df52ce1-2b5f-4d3e-b568-53c5040feb03 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:04.927281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df52ce1-2b5f-4d3e-b568-53c5040feb03 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:04.929511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 66/129] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:04.930619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df52ce1-2b5f-4d3e-b568-53c5040feb03 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:04.950877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e179f-aaed-4dce-801d-9bc5854eb83f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:04.960503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:04.990114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69696fd4-9a5f-4ff6-8fd2-6ea9093fab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:04.990788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69696fd4-9a5f-4ff6-8fd2-6ea9093fab78 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:04.991091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69696fd4-9a5f-4ff6-8fd2-6ea9093fab78 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:04.991376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69696fd4-9a5f-4ff6-8fd2-6ea9093fab78 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:04.992576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69696fd4-9a5f-4ff6-8fd2-6ea9093fab78 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:04.994030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69696fd4-9a5f-4ff6-8fd2-6ea9093fab78 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:04.995719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 64/130] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:05.001195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69696fd4-9a5f-4ff6-8fd2-6ea9093fab78 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:05.045359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df52ce1-2b5f-4d3e-b568-53c5040feb03 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:05.084766 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b90c2-e8ad-4d91-99ec-6bfd047ca965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:05.085697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b90c2-e8ad-4d91-99ec-6bfd047ca965 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.086164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b90c2-e8ad-4d91-99ec-6bfd047ca965 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.086627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b90c2-e8ad-4d91-99ec-6bfd047ca965 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.087864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b90c2-e8ad-4d91-99ec-6bfd047ca965 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:05.089320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b90c2-e8ad-4d91-99ec-6bfd047ca965 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:05.096844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 67/131] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:05.096844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b90c2-e8ad-4d91-99ec-6bfd047ca965 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:05.114032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69696fd4-9a5f-4ff6-8fd2-6ea9093fab78 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:05.148871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6e2e9-b890-4303-a034-a9ba5986d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:05.149539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6e2e9-b890-4303-a034-a9ba5986d081 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.149794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6e2e9-b890-4303-a034-a9ba5986d081 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.150071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6e2e9-b890-4303-a034-a9ba5986d081 None admin] PATH_INFO: `/v3/users/ab79d473dce94574b1e4da104bc02e6b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.151251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6e2e9-b890-4303-a034-a9ba5986d081 None admin] RBAC: Authorizing `identity:get_user(user_id=ab79d473dce94574b1e4da104bc02e6b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:05.152708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6e2e9-b890-4303-a034-a9ba5986d081 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:05.154483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 65/132] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:04 2022] GET /identity/v3/users/ab79d473dce94574b1e4da104bc02e6b => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:05.155539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9047a7-62a1-4ffa-a5c4-89ae05a54ae6 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.155824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9047a7-62a1-4ffa-a5c4-89ae05a54ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.156106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9047a7-62a1-4ffa-a5c4-89ae05a54ae6 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.157471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 66/133] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:05.166805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9047a7-62a1-4ffa-a5c4-89ae05a54ae6 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:05.180731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:05.206098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:05.216986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b90c2-e8ad-4d91-99ec-6bfd047ca965 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:05.253448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e487ff-1bf2-499f-a4d1-b4cd98001bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:05.254126 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e487ff-1bf2-499f-a4d1-b4cd98001bf5 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.254410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e487ff-1bf2-499f-a4d1-b4cd98001bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.254691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e487ff-1bf2-499f-a4d1-b4cd98001bf5 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641/users/ab79d473dce94574b1e4da104bc02e6b/roles/40201003f53c4077b8e412e7d4450cab` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.257145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e487ff-1bf2-499f-a4d1-b4cd98001bf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0de385b20724662bfc182dd6a4c2641, user_id=ab79d473dce94574b1e4da104bc02e6b, role_id=40201003f53c4077b8e412e7d4450cab)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:05.258956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e487ff-1bf2-499f-a4d1-b4cd98001bf5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:05.274303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 68/134] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:32:05 2022] PUT /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641/users/ab79d473dce94574b1e4da104bc02e6b/roles/40201003f53c4077b8e412e7d4450cab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:05.275301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e487ff-1bf2-499f-a4d1-b4cd98001bf5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:05.287474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9047a7-62a1-4ffa-a5c4-89ae05a54ae6 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:05.340325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1bc81-01a5-40c1-8333-65f785e00c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:05.341012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1bc81-01a5-40c1-8333-65f785e00c04 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.341368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1bc81-01a5-40c1-8333-65f785e00c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.342195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1bc81-01a5-40c1-8333-65f785e00c04 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641/users/6889fd2ecc6c467f8af1a4d5c4e42fb5/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.343835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1bc81-01a5-40c1-8333-65f785e00c04 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0de385b20724662bfc182dd6a4c2641, user_id=6889fd2ecc6c467f8af1a4d5c4e42fb5, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:05.345437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1bc81-01a5-40c1-8333-65f785e00c04 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:05.363510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 67/135] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:32:05 2022] PUT /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641/users/6889fd2ecc6c467f8af1a4d5c4e42fb5/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:05.367796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1bc81-01a5-40c1-8333-65f785e00c04 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:05.415652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e487ff-1bf2-499f-a4d1-b4cd98001bf5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:05.467864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb74e0c-d8b0-4908-8530-4ce914505391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:05.468462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb74e0c-d8b0-4908-8530-4ce914505391 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.468771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb74e0c-d8b0-4908-8530-4ce914505391 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.469053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb74e0c-d8b0-4908-8530-4ce914505391 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641/users/ab79d473dce94574b1e4da104bc02e6b/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.472373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb74e0c-d8b0-4908-8530-4ce914505391 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0de385b20724662bfc182dd6a4c2641, user_id=ab79d473dce94574b1e4da104bc02e6b, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:05.474068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb74e0c-d8b0-4908-8530-4ce914505391 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:05.479767 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:05.499743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 69/136] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:32:05 2022] PUT /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641/users/ab79d473dce94574b1e4da104bc02e6b/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:05.503889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ba5df-3135-43d0-a73e-26f9796c9625 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.504508 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ba5df-3135-43d0-a73e-26f9796c9625 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.505007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ba5df-3135-43d0-a73e-26f9796c9625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.530593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-fb9ba5df-3135-43d0-a73e-26f9796c9625 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:05.532644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-fb9ba5df-3135-43d0-a73e-26f9796c9625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:05.533745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1bc81-01a5-40c1-8333-65f785e00c04 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:05.550894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:05.577587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e1fdc-37c1-43f8-919c-d3770c8268ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:05.578308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e1fdc-37c1-43f8-919c-d3770c8268ae None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.578596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e1fdc-37c1-43f8-919c-d3770c8268ae None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.578924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e1fdc-37c1-43f8-919c-d3770c8268ae None admin] PATH_INFO: `/v3/projects/489c81caedde4f28b2a0fd979567a03e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.580875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e1fdc-37c1-43f8-919c-d3770c8268ae None admin] RBAC: Authorizing `identity:get_project(project_id=489c81caedde4f28b2a0fd979567a03e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:05.582622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e1fdc-37c1-43f8-919c-d3770c8268ae None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:05.584562 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 68/137] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:05 2022] GET /identity/v3/projects/489c81caedde4f28b2a0fd979567a03e => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:05.585841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421eb99-5625-472c-95d2-41bde2370045 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.586134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421eb99-5625-472c-95d2-41bde2370045 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.587237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421eb99-5625-472c-95d2-41bde2370045 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.589251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 69/138] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:05.595780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a0c7-0f59-40b3-8ec3-692681a20bb4 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.596078 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a0c7-0f59-40b3-8ec3-692681a20bb4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.596347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a0c7-0f59-40b3-8ec3-692681a20bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.619181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-42a8a0c7-0f59-40b3-8ec3-692681a20bb4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:05.620451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-42a8a0c7-0f59-40b3-8ec3-692681a20bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:05.637306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 70/139] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:05.638978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ba5df-3135-43d0-a73e-26f9796c9625 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:05.752470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 70/140] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:05.776461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ba5df-3135-43d0-a73e-26f9796c9625 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:05.816097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c0080-8520-4eff-9ee1-98191dd0696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:05.816783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0080-8520-4eff-9ee1-98191dd0696f None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:05.817064 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0080-8520-4eff-9ee1-98191dd0696f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:05.817342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0080-8520-4eff-9ee1-98191dd0696f None admin] PATH_INFO: `/v3/projects/489c81caedde4f28b2a0fd979567a03e/users/ab79d473dce94574b1e4da104bc02e6b/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:05.819306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c0080-8520-4eff-9ee1-98191dd0696f None admin] RBAC: Authorizing `identity:create_grant(project_id=489c81caedde4f28b2a0fd979567a03e, user_id=ab79d473dce94574b1e4da104bc02e6b, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:05.820860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c0080-8520-4eff-9ee1-98191dd0696f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:05.836558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 71/141] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:32:05 2022] PUT /identity/v3/projects/489c81caedde4f28b2a0fd979567a03e/users/ab79d473dce94574b1e4da104bc02e6b/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:06.029292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a0c7-0f59-40b3-8ec3-692681a20bb4 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:06.109540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:06.150148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a0c7-0f59-40b3-8ec3-692681a20bb4 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:06.198519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dae4a4-35f4-46f0-a3a0-d8f52222b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:06.199371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dae4a4-35f4-46f0-a3a0-d8f52222b6ee None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:06.199754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dae4a4-35f4-46f0-a3a0-d8f52222b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:06.200128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dae4a4-35f4-46f0-a3a0-d8f52222b6ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:06.207497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dae4a4-35f4-46f0-a3a0-d8f52222b6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:06.209235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dae4a4-35f4-46f0-a3a0-d8f52222b6ee None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:06.211003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 71/142] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:06.216649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c0080-8520-4eff-9ee1-98191dd0696f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:06.219701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:06.339940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dae4a4-35f4-46f0-a3a0-d8f52222b6ee None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:06.357325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c0080-8520-4eff-9ee1-98191dd0696f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:06.397344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe7239-b8d4-491d-8b35-5472de3a88fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:06.398348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe7239-b8d4-491d-8b35-5472de3a88fa None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:06.398794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe7239-b8d4-491d-8b35-5472de3a88fa None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:06.399295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe7239-b8d4-491d-8b35-5472de3a88fa None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:06.400097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe7239-b8d4-491d-8b35-5472de3a88fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:06.401799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe7239-b8d4-491d-8b35-5472de3a88fa None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:06.429827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 72/143] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:06 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:06.509453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dae4a4-35f4-46f0-a3a0-d8f52222b6ee None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:06.557998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6304de6-8401-4e18-80ea-f11d96cb5c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:06.559054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6304de6-8401-4e18-80ea-f11d96cb5c0f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:06.559486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6304de6-8401-4e18-80ea-f11d96cb5c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:06.559934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6304de6-8401-4e18-80ea-f11d96cb5c0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:06.569786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:06.578362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6304de6-8401-4e18-80ea-f11d96cb5c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-c6304de6-8401-4e18-80ea-f11d96cb5c0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:06.586014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:06.587633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:06.588807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:06.590937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 72/144] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:06.597979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe7239-b8d4-491d-8b35-5472de3a88fa None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:06.686450 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:06.743363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe7239-b8d4-491d-8b35-5472de3a88fa None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:06.791608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fc73e-93fd-4833-84cc-ed1e0949d440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:06.792927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc73e-93fd-4833-84cc-ed1e0949d440 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:06.793461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc73e-93fd-4833-84cc-ed1e0949d440 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:06.793880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc73e-93fd-4833-84cc-ed1e0949d440 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:06.794714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fc73e-93fd-4833-84cc-ed1e0949d440 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:06.795226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fc73e-93fd-4833-84cc-ed1e0949d440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:06.796796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fc73e-93fd-4833-84cc-ed1e0949d440 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:06.808299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 73/145] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:06.815416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6304de6-8401-4e18-80ea-f11d96cb5c0f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:06.940757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6304de6-8401-4e18-80ea-f11d96cb5c0f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:06.985596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904f24d-1ffa-478d-83ed-e6b0c118a71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:06.986885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904f24d-1ffa-478d-83ed-e6b0c118a71d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:06.987180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904f24d-1ffa-478d-83ed-e6b0c118a71d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:06.987466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904f24d-1ffa-478d-83ed-e6b0c118a71d None admin] PATH_INFO: `/v3/users/943ef6b09f6840ed8c7596959f7c2ac3` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:06.988709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904f24d-1ffa-478d-83ed-e6b0c118a71d None admin] RBAC: Authorizing `identity:get_user(user_id=943ef6b09f6840ed8c7596959f7c2ac3)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:06.990243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904f24d-1ffa-478d-83ed-e6b0c118a71d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:06.991920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 73/146] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:06 2022] GET /identity/v3/users/943ef6b09f6840ed8c7596959f7c2ac3 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:06.997617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fc73e-93fd-4833-84cc-ed1e0949d440 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:07.126933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fc73e-93fd-4833-84cc-ed1e0949d440 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:07.155717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:07.178298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43febba7-09e1-410b-9403-dae8fb6bb052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:07.179416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43febba7-09e1-410b-9403-dae8fb6bb052 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:07.179876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43febba7-09e1-410b-9403-dae8fb6bb052 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:07.180323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43febba7-09e1-410b-9403-dae8fb6bb052 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:07.181637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43febba7-09e1-410b-9403-dae8fb6bb052 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:07.183344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43febba7-09e1-410b-9403-dae8fb6bb052 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:07.185193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 74/147] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:06 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:07.191351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904f24d-1ffa-478d-83ed-e6b0c118a71d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:07.276853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:07.315490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904f24d-1ffa-478d-83ed-e6b0c118a71d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:07.357316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca198c-d31b-4407-889d-83abed5e02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:07.358002 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca198c-d31b-4407-889d-83abed5e02c4 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:07.358288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca198c-d31b-4407-889d-83abed5e02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:07.358565 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca198c-d31b-4407-889d-83abed5e02c4 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641/users/943ef6b09f6840ed8c7596959f7c2ac3/roles/fcc7d8db3d7249f393782c75305077c2` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:07.363566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca198c-d31b-4407-889d-83abed5e02c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0de385b20724662bfc182dd6a4c2641, user_id=943ef6b09f6840ed8c7596959f7c2ac3, role_id=fcc7d8db3d7249f393782c75305077c2)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:07.365055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca198c-d31b-4407-889d-83abed5e02c4 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:07.379739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 74/148] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:32:07 2022] PUT /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641/users/943ef6b09f6840ed8c7596959f7c2ac3/roles/fcc7d8db3d7249f393782c75305077c2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:32:07.954993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84cebb-8c7b-418a-aafd-3813582f376c None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:07.955482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84cebb-8c7b-418a-aafd-3813582f376c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:07.955695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84cebb-8c7b-418a-aafd-3813582f376c None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:07.957349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 75/149] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:07.965598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5881846-2fb5-451e-a651-4127baa28564 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:07.965909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5881846-2fb5-451e-a651-4127baa28564 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:07.966211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5881846-2fb5-451e-a651-4127baa28564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:07.996939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e5881846-2fb5-451e-a651-4127baa28564 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:07.998227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e5881846-2fb5-451e-a651-4127baa28564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:08.090879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 75/150] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:08.530682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad73a70-3000-4de8-9924-6de0abfe851c None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:08.531067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad73a70-3000-4de8-9924-6de0abfe851c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:08.531281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad73a70-3000-4de8-9924-6de0abfe851c None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:08.533592 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 76/151] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:08.539153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71cff8-6027-491c-9e15-920c9ff30dba None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:08.539610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71cff8-6027-491c-9e15-920c9ff30dba None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:08.539805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71cff8-6027-491c-9e15-920c9ff30dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:08.561846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6b71cff8-6027-491c-9e15-920c9ff30dba None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:08.563159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6b71cff8-6027-491c-9e15-920c9ff30dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:08.639180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad73a70-3000-4de8-9924-6de0abfe851c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:08.642418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:08.674671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 76/152] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:08.796940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3df997-a8c9-4aa1-88c1-a7b6315b049a None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:08.797097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad73a70-3000-4de8-9924-6de0abfe851c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:08.797174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3df997-a8c9-4aa1-88c1-a7b6315b049a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:08.797456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3df997-a8c9-4aa1-88c1-a7b6315b049a None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:08.800103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 77/153] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:32:08.805644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c836f47-3d9d-46c3-b0d9-a220bc836d3e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:08.805949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c836f47-3d9d-46c3-b0d9-a220bc836d3e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:08.806274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c836f47-3d9d-46c3-b0d9-a220bc836d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:08.847730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5c836f47-3d9d-46c3-b0d9-a220bc836d3e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:08.849008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5c836f47-3d9d-46c3-b0d9-a220bc836d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:08.870495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dedd0-7a85-44df-addc-e65fbfd1ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:08.871291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dedd0-7a85-44df-addc-e65fbfd1ac2a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:08.871575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dedd0-7a85-44df-addc-e65fbfd1ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:08.871879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dedd0-7a85-44df-addc-e65fbfd1ac2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:08.899232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dedd0-7a85-44df-addc-e65fbfd1ac2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-b31dedd0-7a85-44df-addc-e65fbfd1ac2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:08.908975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:08.909898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:08.910653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 77/154] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:08.919609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dedd0-7a85-44df-addc-e65fbfd1ac2a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:09.006965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 78/155] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:09.021418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:09.088659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dedd0-7a85-44df-addc-e65fbfd1ac2a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:09.128227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cd9f9-fd74-4515-8334-6eb822269902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:09.128876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cd9f9-fd74-4515-8334-6eb822269902 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:09.129175 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cd9f9-fd74-4515-8334-6eb822269902 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:09.129470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cd9f9-fd74-4515-8334-6eb822269902 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:09.130177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cd9f9-fd74-4515-8334-6eb822269902 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:09.130501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cd9f9-fd74-4515-8334-6eb822269902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:09.132089 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cd9f9-fd74-4515-8334-6eb822269902 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:09.141270 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 78/156] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:09.148331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c836f47-3d9d-46c3-b0d9-a220bc836d3e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:09.260551 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cd9f9-fd74-4515-8334-6eb822269902 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:09.300279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c836f47-3d9d-46c3-b0d9-a220bc836d3e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:09.343939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:09.400203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed04c5-5b92-4759-af62-caa478fb0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:09.400863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed04c5-5b92-4759-af62-caa478fb0eca None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:09.401147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed04c5-5b92-4759-af62-caa478fb0eca None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:09.401423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed04c5-5b92-4759-af62-caa478fb0eca None admin] PATH_INFO: `/v3/users/ab79d473dce94574b1e4da104bc02e6b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:09.405491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cd9f9-fd74-4515-8334-6eb822269902 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:09.407588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed04c5-5b92-4759-af62-caa478fb0eca None admin] RBAC: Authorizing `identity:get_user(user_id=ab79d473dce94574b1e4da104bc02e6b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:09.409687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed04c5-5b92-4759-af62-caa478fb0eca None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:09.411728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 79/157] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:09 2022] GET /identity/v3/users/ab79d473dce94574b1e4da104bc02e6b => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:09.417240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed04c5-5b92-4759-af62-caa478fb0eca None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:09.418260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:09.447022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a4d1-ee15-42c0-9720-1f13f4cafddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:09.447906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a4d1-ee15-42c0-9720-1f13f4cafddb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:09.448207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a4d1-ee15-42c0-9720-1f13f4cafddb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:09.448566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a4d1-ee15-42c0-9720-1f13f4cafddb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:09.462404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3a4d1-ee15-42c0-9720-1f13f4cafddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-b4b3a4d1-ee15-42c0-9720-1f13f4cafddb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:09.467731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:09.468782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:09.469617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 79/158] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:09.475302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a4d1-ee15-42c0-9720-1f13f4cafddb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:09.585637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a4d1-ee15-42c0-9720-1f13f4cafddb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:09.642320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95a118-b72d-4886-a61b-6151ef3d2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:09.642942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95a118-b72d-4886-a61b-6151ef3d2329 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:09.643224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95a118-b72d-4886-a61b-6151ef3d2329 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:09.643496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95a118-b72d-4886-a61b-6151ef3d2329 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:09.644166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95a118-b72d-4886-a61b-6151ef3d2329 None admin] RBAC: Adding query filter params (name=member) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:09.644467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95a118-b72d-4886-a61b-6151ef3d2329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:09.645849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95a118-b72d-4886-a61b-6151ef3d2329 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:09.664798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed04c5-5b92-4759-af62-caa478fb0eca None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:09.667041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 80/159] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:09.668297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41ff6e-d26e-45db-b838-1c7009dff646 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:09.668587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41ff6e-d26e-45db-b838-1c7009dff646 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:09.668860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41ff6e-d26e-45db-b838-1c7009dff646 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:09.670083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 81/160] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:09.670803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41ff6e-d26e-45db-b838-1c7009dff646 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:09.723434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:09.755422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8215ba-de8e-4a49-8810-358a69766af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:09.756034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8215ba-de8e-4a49-8810-358a69766af7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:09.756316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8215ba-de8e-4a49-8810-358a69766af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:09.756587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8215ba-de8e-4a49-8810-358a69766af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:09.888688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:09.912555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41ff6e-d26e-45db-b838-1c7009dff646 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:09.917572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8215ba-de8e-4a49-8810-358a69766af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:09.919069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8215ba-de8e-4a49-8810-358a69766af7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:09.979366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d40d-c678-46a1-a326-5016a5f13675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:09.980446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d40d-c678-46a1-a326-5016a5f13675 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:09.980927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d40d-c678-46a1-a326-5016a5f13675 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:09.981405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d40d-c678-46a1-a326-5016a5f13675 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:09.999102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3d40d-c678-46a1-a326-5016a5f13675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-6be3d40d-c678-46a1-a326-5016a5f13675 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:10.005366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:10.006320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:10.007102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:10.009792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 82/161] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:32:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:10.010877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d40d-c678-46a1-a326-5016a5f13675 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:10.163224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:10.192793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d40d-c678-46a1-a326-5016a5f13675 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:10.213649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 80/162] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:10.215020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397e0f0-3918-4045-866d-4ff403ed55e0 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:10.215416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397e0f0-3918-4045-866d-4ff403ed55e0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:10.215689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397e0f0-3918-4045-866d-4ff403ed55e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:10.255884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-8397e0f0-3918-4045-866d-4ff403ed55e0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:10.257218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8397e0f0-3918-4045-866d-4ff403ed55e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:10.288018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14caeaa-afac-48e8-8b5b-ee3525fe2e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:10.288839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14caeaa-afac-48e8-8b5b-ee3525fe2e08 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:10.289124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14caeaa-afac-48e8-8b5b-ee3525fe2e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:10.289402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14caeaa-afac-48e8-8b5b-ee3525fe2e08 None admin] PATH_INFO: `/v3/users/ab79d473dce94574b1e4da104bc02e6b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:10.291841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14caeaa-afac-48e8-8b5b-ee3525fe2e08 None admin] RBAC: Authorizing `identity:get_user(user_id=ab79d473dce94574b1e4da104bc02e6b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:10.293363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14caeaa-afac-48e8-8b5b-ee3525fe2e08 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:10.297561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 83/163] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:10 2022] GET /identity/v3/users/ab79d473dce94574b1e4da104bc02e6b => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:10.299197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14caeaa-afac-48e8-8b5b-ee3525fe2e08 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:10.401424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 81/164] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:10.402325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397e0f0-3918-4045-866d-4ff403ed55e0 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:10.429598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:10.535005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14caeaa-afac-48e8-8b5b-ee3525fe2e08 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:10.579475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78a0a9-e412-402d-a57e-e7a2662664b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:10.580273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78a0a9-e412-402d-a57e-e7a2662664b5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:10.580556 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78a0a9-e412-402d-a57e-e7a2662664b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:10.580827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78a0a9-e412-402d-a57e-e7a2662664b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:10.581493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78a0a9-e412-402d-a57e-e7a2662664b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:10.581791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78a0a9-e412-402d-a57e-e7a2662664b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:10.583210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78a0a9-e412-402d-a57e-e7a2662664b5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:10.592675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 84/165] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:10.593517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78a0a9-e412-402d-a57e-e7a2662664b5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:10.598160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397e0f0-3918-4045-866d-4ff403ed55e0 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:10.646025 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:10.724016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf91ff-4338-4c9c-b7dc-947c3e61671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:10.726987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf91ff-4338-4c9c-b7dc-947c3e61671a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:10.726987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf91ff-4338-4c9c-b7dc-947c3e61671a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:10.726987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf91ff-4338-4c9c-b7dc-947c3e61671a None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:10.729392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf91ff-4338-4c9c-b7dc-947c3e61671a None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:10.731567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf91ff-4338-4c9c-b7dc-947c3e61671a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:10.738791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 82/166] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:10 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:10.738791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf91ff-4338-4c9c-b7dc-947c3e61671a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:10.906407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78a0a9-e412-402d-a57e-e7a2662664b5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:11.022877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872ec1a-247a-4eb8-b29f-41b6f677f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:11.022877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872ec1a-247a-4eb8-b29f-41b6f677f093 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.022877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872ec1a-247a-4eb8-b29f-41b6f677f093 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.022877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872ec1a-247a-4eb8-b29f-41b6f677f093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.041393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:11.076760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf91ff-4338-4c9c-b7dc-947c3e61671a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:11.138819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286f14c-f1d6-479f-8e8b-b0fcf4defcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:11.139852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286f14c-f1d6-479f-8e8b-b0fcf4defcbe None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.140334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286f14c-f1d6-479f-8e8b-b0fcf4defcbe None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.140804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286f14c-f1d6-479f-8e8b-b0fcf4defcbe None admin] PATH_INFO: `/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.142756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286f14c-f1d6-479f-8e8b-b0fcf4defcbe None admin] RBAC: Authorizing `identity:get_user(user_id=6889fd2ecc6c467f8af1a4d5c4e42fb5)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:11.144497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286f14c-f1d6-479f-8e8b-b0fcf4defcbe None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:11.146323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 83/167] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:10 2022] GET /identity/v3/users/6889fd2ecc6c467f8af1a4d5c4e42fb5 => generated 247 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:11.147723 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0233dd9-b67c-4a03-920b-e86e32454dc6 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.147865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872ec1a-247a-4eb8-b29f-41b6f677f093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:11.148366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0233dd9-b67c-4a03-920b-e86e32454dc6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.148880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0233dd9-b67c-4a03-920b-e86e32454dc6 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.149643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872ec1a-247a-4eb8-b29f-41b6f677f093 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:11.150551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 84/168] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:11.151463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0233dd9-b67c-4a03-920b-e86e32454dc6 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:11.177291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:11.266105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0233dd9-b67c-4a03-920b-e86e32454dc6 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:11.274791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 85/169] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.274791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872ec1a-247a-4eb8-b29f-41b6f677f093 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:11.305437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05e46a-eb13-4eaf-b502-d9241e048f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:11.306349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e46a-eb13-4eaf-b502-d9241e048f54 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.306745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e46a-eb13-4eaf-b502-d9241e048f54 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.307184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05e46a-eb13-4eaf-b502-d9241e048f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.307912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e46a-eb13-4eaf-b502-d9241e048f54 None admin] RBAC: Adding query filter params (role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=b0de385b20724662bfc182dd6a4c2641, user.id=ab79d473dce94574b1e4da104bc02e6b) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:11.308215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e46a-eb13-4eaf-b502-d9241e048f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:11.311406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05e46a-eb13-4eaf-b502-d9241e048f54 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:11.319047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 85/170] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:11 2022] GET /identity/v3/role_assignments?user.id=ab79d473dce94574b1e4da104bc02e6b&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=40201003f53c4077b8e412e7d4450cab => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:11.320094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c98cc-357e-4180-9878-70e7593dec57 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.320375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c98cc-357e-4180-9878-70e7593dec57 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.320644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c98cc-357e-4180-9878-70e7593dec57 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.322028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 86/171] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:11.322984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6cdc-d232-4e43-ab1c-b3143cd68cd8 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.323261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6cdc-d232-4e43-ab1c-b3143cd68cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.323528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6cdc-d232-4e43-ab1c-b3143cd68cd8 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.329268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 87/172] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:11.329268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6cdc-d232-4e43-ab1c-b3143cd68cd8 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:11.355237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:11.415007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872ec1a-247a-4eb8-b29f-41b6f677f093 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:11.441816 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:11.456343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e4299-684c-4abc-8d76-295cffb38251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:11.457045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e4299-684c-4abc-8d76-295cffb38251 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.457325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e4299-684c-4abc-8d76-295cffb38251 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.457595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e4299-684c-4abc-8d76-295cffb38251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.468992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e4299-684c-4abc-8d76-295cffb38251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-b47e4299-684c-4abc-8d76-295cffb38251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:11.473796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:11.474722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:11.475571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 86/173] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:11.476343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd1921-de52-4edb-b0f2-49690fa29a33 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.476419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd1921-de52-4edb-b0f2-49690fa29a33 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.477007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd1921-de52-4edb-b0f2-49690fa29a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.477581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6cdc-d232-4e43-ab1c-b3143cd68cd8 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:11.497516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-21cd1921-de52-4edb-b0f2-49690fa29a33 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:11.499496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-21cd1921-de52-4edb-b0f2-49690fa29a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:11.529931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14e467-2b55-4e7e-959e-a2e071a5079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:11.530476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e467-2b55-4e7e-959e-a2e071a5079b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.530753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e467-2b55-4e7e-959e-a2e071a5079b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.531090 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e467-2b55-4e7e-959e-a2e071a5079b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.598025 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 87/174] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:11.598911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd1921-de52-4edb-b0f2-49690fa29a33 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:11.614714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14e467-2b55-4e7e-959e-a2e071a5079b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:11.616613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14e467-2b55-4e7e-959e-a2e071a5079b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:11.636759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:11.721884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd1921-de52-4edb-b0f2-49690fa29a33 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:11.729802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 88/175] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.732182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6302e5-60be-480a-a2d9-1c8a69ef7379 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.732479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6302e5-60be-480a-a2d9-1c8a69ef7379 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.732755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6302e5-60be-480a-a2d9-1c8a69ef7379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.736410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:11.753552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6e6302e5-60be-480a-a2d9-1c8a69ef7379 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:11.754758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6e6302e5-60be-480a-a2d9-1c8a69ef7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:11.760973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5f33d-eaba-4f90-b5a5-ccce53a0ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:11.761617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5f33d-eaba-4f90-b5a5-ccce53a0ec04 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.761898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5f33d-eaba-4f90-b5a5-ccce53a0ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.762179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5f33d-eaba-4f90-b5a5-ccce53a0ec04 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.763336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5f33d-eaba-4f90-b5a5-ccce53a0ec04 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:11.764805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5f33d-eaba-4f90-b5a5-ccce53a0ec04 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:11.766633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 88/176] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:11 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:11.768205 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1562e06-ca7a-4890-9e77-867db597bd74 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.768492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1562e06-ca7a-4890-9e77-867db597bd74 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.768769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1562e06-ca7a-4890-9e77-867db597bd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.787836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c1562e06-ca7a-4890-9e77-867db597bd74 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:11.789300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c1562e06-ca7a-4890-9e77-867db597bd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:11.840690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 89/177] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:11.841368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6302e5-60be-480a-a2d9-1c8a69ef7379 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:11.874873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 89/178] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:11.876391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7ea32-9d4b-4ce0-a24d-4c367446cbc1 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:11.877250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7ea32-9d4b-4ce0-a24d-4c367446cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:11.877543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7ea32-9d4b-4ce0-a24d-4c367446cbc1 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:11.879468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 90/179] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:11.882833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7ea32-9d4b-4ce0-a24d-4c367446cbc1 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:11.913167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:11.988214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6302e5-60be-480a-a2d9-1c8a69ef7379 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.003678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7ea32-9d4b-4ce0-a24d-4c367446cbc1 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.016819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:12.045262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f281230-8b15-4827-abcf-3fbcacee6f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.046916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f281230-8b15-4827-abcf-3fbcacee6f1b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.047198 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c5a92-afa7-4675-b198-59606809b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.047838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f281230-8b15-4827-abcf-3fbcacee6f1b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.048407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f281230-8b15-4827-abcf-3fbcacee6f1b None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.049330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f281230-8b15-4827-abcf-3fbcacee6f1b None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:12.049772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f281230-8b15-4827-abcf-3fbcacee6f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:12.050429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c5a92-afa7-4675-b198-59606809b773 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.050863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c5a92-afa7-4675-b198-59606809b773 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.052122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f281230-8b15-4827-abcf-3fbcacee6f1b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:12.053706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c5a92-afa7-4675-b198-59606809b773 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.055141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c5a92-afa7-4675-b198-59606809b773 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:12.056789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c5a92-afa7-4675-b198-59606809b773 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:12.058679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 91/180] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:11 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:12.059782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c5a92-afa7-4675-b198-59606809b773 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.065574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 90/181] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:12.071973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc97d4-2266-4323-b798-aa9cc2a7e4e2 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.072432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc97d4-2266-4323-b798-aa9cc2a7e4e2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.073327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc97d4-2266-4323-b798-aa9cc2a7e4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.099037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4ecc97d4-2266-4323-b798-aa9cc2a7e4e2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:12.101232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4ecc97d4-2266-4323-b798-aa9cc2a7e4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:12.173591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c5a92-afa7-4675-b198-59606809b773 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.175364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 91/182] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:12.183704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc97d4-2266-4323-b798-aa9cc2a7e4e2 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.215193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c3622-6830-4b3d-8d08-8cf1285b52cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.215895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c3622-6830-4b3d-8d08-8cf1285b52cc None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.216070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c3622-6830-4b3d-8d08-8cf1285b52cc None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.216346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c3622-6830-4b3d-8d08-8cf1285b52cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.217078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c3622-6830-4b3d-8d08-8cf1285b52cc None admin] RBAC: Adding query filter params (role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=b0de385b20724662bfc182dd6a4c2641, user.id=ab79d473dce94574b1e4da104bc02e6b) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:12.217372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c3622-6830-4b3d-8d08-8cf1285b52cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:12.218823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c3622-6830-4b3d-8d08-8cf1285b52cc None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:12.224701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 92/183] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/role_assignments?user.id=ab79d473dce94574b1e4da104bc02e6b&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:12.224701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c3622-6830-4b3d-8d08-8cf1285b52cc None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.231464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:12.283097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:12.333072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc97d4-2266-4323-b798-aa9cc2a7e4e2 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.366415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c3622-6830-4b3d-8d08-8cf1285b52cc None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.395625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0746f-b25b-48a6-86e1-93c9be3a36ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.397165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0746f-b25b-48a6-86e1-93c9be3a36ba None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.397455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0746f-b25b-48a6-86e1-93c9be3a36ba None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.398420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0746f-b25b-48a6-86e1-93c9be3a36ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.412635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0746f-b25b-48a6-86e1-93c9be3a36ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:12.418915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f27a6-9214-4d20-bcb9-43292d521d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.419527 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f27a6-9214-4d20-bcb9-43292d521d51 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.419803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f27a6-9214-4d20-bcb9-43292d521d51 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.420073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f27a6-9214-4d20-bcb9-43292d521d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.424573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f27a6-9214-4d20-bcb9-43292d521d51 None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=b0de385b20724662bfc182dd6a4c2641, user.id=6889fd2ecc6c467f8af1a4d5c4e42fb5) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:12.424573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f27a6-9214-4d20-bcb9-43292d521d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-62d0746f-b25b-48a6-86e1-93c9be3a36ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:12.424807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:12.425619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:12.426376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 92/184] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:12.427058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f27a6-9214-4d20-bcb9-43292d521d51 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:12.427123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0746f-b25b-48a6-86e1-93c9be3a36ba None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.431905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 93/185] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/role_assignments?user.id=6889fd2ecc6c467f8af1a4d5c4e42fb5&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:12.431905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f27a6-9214-4d20-bcb9-43292d521d51 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.557522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:12.562434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0746f-b25b-48a6-86e1-93c9be3a36ba None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.578393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f27a6-9214-4d20-bcb9-43292d521d51 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.587337 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:12.612874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40dde1-762c-4702-9b1a-d126b4a4e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.613515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40dde1-762c-4702-9b1a-d126b4a4e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.613797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40dde1-762c-4702-9b1a-d126b4a4e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.614074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40dde1-762c-4702-9b1a-d126b4a4e9f1 None admin] PATH_INFO: `/v3/users/ab79d473dce94574b1e4da104bc02e6b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.615344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40dde1-762c-4702-9b1a-d126b4a4e9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=ab79d473dce94574b1e4da104bc02e6b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:12.616839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40dde1-762c-4702-9b1a-d126b4a4e9f1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:12.619038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 93/186] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/users/ab79d473dce94574b1e4da104bc02e6b => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:12.619351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40dde1-762c-4702-9b1a-d126b4a4e9f1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.625584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7fc75-a9e9-4094-a847-7ac6f6c586a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.626820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7fc75-a9e9-4094-a847-7ac6f6c586a4 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.629915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7fc75-a9e9-4094-a847-7ac6f6c586a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.629915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7fc75-a9e9-4094-a847-7ac6f6c586a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.641241 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7fc75-a9e9-4094-a847-7ac6f6c586a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-dea7fc75-a9e9-4094-a847-7ac6f6c586a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:12.648892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:12.649802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:12.650585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 94/187] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:12.652976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7fc75-a9e9-4094-a847-7ac6f6c586a4 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.734243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40dde1-762c-4702-9b1a-d126b4a4e9f1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.766385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7fc75-a9e9-4094-a847-7ac6f6c586a4 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.770600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106eb2-bf62-4462-8f4f-7803efa17016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.771256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106eb2-bf62-4462-8f4f-7803efa17016 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.771532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106eb2-bf62-4462-8f4f-7803efa17016 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.771803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106eb2-bf62-4462-8f4f-7803efa17016 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.783305 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106eb2-bf62-4462-8f4f-7803efa17016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-09106eb2-bf62-4462-8f4f-7803efa17016 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:12.788065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:12.788973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:12.789753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 94/188] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:12.790433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106eb2-bf62-4462-8f4f-7803efa17016 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.804003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6143-14a8-4839-a7d6-34fdfb2d1793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.804614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6143-14a8-4839-a7d6-34fdfb2d1793 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.804892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6143-14a8-4839-a7d6-34fdfb2d1793 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.805165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6143-14a8-4839-a7d6-34fdfb2d1793 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.805857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec6143-14a8-4839-a7d6-34fdfb2d1793 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:12.806155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec6143-14a8-4839-a7d6-34fdfb2d1793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:12.807572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec6143-14a8-4839-a7d6-34fdfb2d1793 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:12.816131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 95/189] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:12.816131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6143-14a8-4839-a7d6-34fdfb2d1793 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.824233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:12.847029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:12.904005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106eb2-bf62-4462-8f4f-7803efa17016 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.921565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6143-14a8-4839-a7d6-34fdfb2d1793 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:12.937227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082887-bdc8-4e16-b098-ef0840eaf0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.940491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082887-bdc8-4e16-b098-ef0840eaf0c3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.940491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082887-bdc8-4e16-b098-ef0840eaf0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.940491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082887-bdc8-4e16-b098-ef0840eaf0c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:12.940491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37082887-bdc8-4e16-b098-ef0840eaf0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:12.941781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37082887-bdc8-4e16-b098-ef0840eaf0c3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:12.943414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 95/190] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:12.944188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082887-bdc8-4e16-b098-ef0840eaf0c3 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:12.964474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ff9b1-1e84-4b7b-8d4a-5b6dfe2c7a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:12.965087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ff9b1-1e84-4b7b-8d4a-5b6dfe2c7a07 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:12.965369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ff9b1-1e84-4b7b-8d4a-5b6dfe2c7a07 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:12.965645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ff9b1-1e84-4b7b-8d4a-5b6dfe2c7a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.035157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ff9b1-1e84-4b7b-8d4a-5b6dfe2c7a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.036634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ff9b1-1e84-4b7b-8d4a-5b6dfe2c7a07 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:13.039359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:13.045907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082887-bdc8-4e16-b098-ef0840eaf0c3 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:13.064613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:13.082338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d306ce-c045-4f33-b4ab-ad92a3e72126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:13.082979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d306ce-c045-4f33-b4ab-ad92a3e72126 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:13.083261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d306ce-c045-4f33-b4ab-ad92a3e72126 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:13.083543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d306ce-c045-4f33-b4ab-ad92a3e72126 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.084207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d306ce-c045-4f33-b4ab-ad92a3e72126 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:13.084509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d306ce-c045-4f33-b4ab-ad92a3e72126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.085876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d306ce-c045-4f33-b4ab-ad92a3e72126 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:13.093743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 96/191] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:13.094538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d306ce-c045-4f33-b4ab-ad92a3e72126 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:13.139700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 96/192] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:13.140555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ff9b1-1e84-4b7b-8d4a-5b6dfe2c7a07 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:13.201963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d306ce-c045-4f33-b4ab-ad92a3e72126 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:13.235193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c7689-0ea0-4e13-aa4f-81042cbda457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:13.236384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c7689-0ea0-4e13-aa4f-81042cbda457 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:13.236573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c7689-0ea0-4e13-aa4f-81042cbda457 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:13.236834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c7689-0ea0-4e13-aa4f-81042cbda457 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.237484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c7689-0ea0-4e13-aa4f-81042cbda457 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:13.237778 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c7689-0ea0-4e13-aa4f-81042cbda457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.239164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c7689-0ea0-4e13-aa4f-81042cbda457 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:13.244180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ff9b1-1e84-4b7b-8d4a-5b6dfe2c7a07 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:13.247142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 97/193] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:13.247923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c7689-0ea0-4e13-aa4f-81042cbda457 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:13.266993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:13.275964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:13.283875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467aa46-aae6-4c26-8113-007ecd62a32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:13.284513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467aa46-aae6-4c26-8113-007ecd62a32d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:13.284791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467aa46-aae6-4c26-8113-007ecd62a32d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:13.285063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467aa46-aae6-4c26-8113-007ecd62a32d None admin] PATH_INFO: `/v3/users/943ef6b09f6840ed8c7596959f7c2ac3` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.286183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467aa46-aae6-4c26-8113-007ecd62a32d None admin] RBAC: Authorizing `identity:get_user(user_id=943ef6b09f6840ed8c7596959f7c2ac3)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.287653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467aa46-aae6-4c26-8113-007ecd62a32d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:13.289268 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 97/194] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:13 2022] GET /identity/v3/users/943ef6b09f6840ed8c7596959f7c2ac3 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:13.290009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467aa46-aae6-4c26-8113-007ecd62a32d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:13.352182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c7689-0ea0-4e13-aa4f-81042cbda457 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:13.387330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863f91-cf72-433b-8740-6cdd34787dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:13.387940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863f91-cf72-433b-8740-6cdd34787dc9 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:13.388218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863f91-cf72-433b-8740-6cdd34787dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:13.388485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863f91-cf72-433b-8740-6cdd34787dc9 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.389119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8863f91-cf72-433b-8740-6cdd34787dc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.390611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8863f91-cf72-433b-8740-6cdd34787dc9 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:13.393540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467aa46-aae6-4c26-8113-007ecd62a32d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:13.414377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 98/195] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:13 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:13.415319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863f91-cf72-433b-8740-6cdd34787dc9 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:13.447977 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16baf2-813a-464e-b341-e56aa5a323e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:13.448621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16baf2-813a-464e-b341-e56aa5a323e7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:13.448906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16baf2-813a-464e-b341-e56aa5a323e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:13.449180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16baf2-813a-464e-b341-e56aa5a323e7 None admin] PATH_INFO: `/v3/users/4f898d3ad145411fb6d01ea4688bbb21` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.465740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16baf2-813a-464e-b341-e56aa5a323e7 None admin] RBAC: Authorizing `identity:get_user(user_id=4f898d3ad145411fb6d01ea4688bbb21)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.467328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16baf2-813a-464e-b341-e56aa5a323e7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:13.469148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 98/196] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:13 2022] GET /identity/v3/users/4f898d3ad145411fb6d01ea4688bbb21 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:13.469989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16baf2-813a-464e-b341-e56aa5a323e7 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:13.525020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:13.539277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:13.562329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863f91-cf72-433b-8740-6cdd34787dc9 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:13.592315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16baf2-813a-464e-b341-e56aa5a323e7 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:13.612148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9a443-da71-4ac0-a392-d5e3a0ad1bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:13.612832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9a443-da71-4ac0-a392-d5e3a0ad1bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:13.613121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9a443-da71-4ac0-a392-d5e3a0ad1bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:13.613399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9a443-da71-4ac0-a392-d5e3a0ad1bf0 None admin] PATH_INFO: `/v3/projects/489c81caedde4f28b2a0fd979567a03e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.614582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9a443-da71-4ac0-a392-d5e3a0ad1bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=489c81caedde4f28b2a0fd979567a03e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.616159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9a443-da71-4ac0-a392-d5e3a0ad1bf0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:13.617973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 99/197] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:13 2022] GET /identity/v3/projects/489c81caedde4f28b2a0fd979567a03e => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:13.618540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9a443-da71-4ac0-a392-d5e3a0ad1bf0 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:13.642739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb735ff3-227e-4432-9223-11dc300c61e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:13.643437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb735ff3-227e-4432-9223-11dc300c61e7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:13.646795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb735ff3-227e-4432-9223-11dc300c61e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:13.646795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb735ff3-227e-4432-9223-11dc300c61e7 None admin] PATH_INFO: `/v3/users/4f898d3ad145411fb6d01ea4688bbb21` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.646795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb735ff3-227e-4432-9223-11dc300c61e7 None admin] RBAC: Authorizing `identity:get_user(user_id=4f898d3ad145411fb6d01ea4688bbb21)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.646795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb735ff3-227e-4432-9223-11dc300c61e7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:13.648496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 99/198] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:13 2022] GET /identity/v3/users/4f898d3ad145411fb6d01ea4688bbb21 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:13.649049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb735ff3-227e-4432-9223-11dc300c61e7 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:13.774472 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9a443-da71-4ac0-a392-d5e3a0ad1bf0 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:13.806012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb735ff3-227e-4432-9223-11dc300c61e7 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:13.821089 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb8c78-23fd-4d0c-a7d5-f719243d9b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:13.822903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb8c78-23fd-4d0c-a7d5-f719243d9b9e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:13.823430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb8c78-23fd-4d0c-a7d5-f719243d9b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:13.823888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb8c78-23fd-4d0c-a7d5-f719243d9b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.841204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:13.847311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:13.852967 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059e9e-1693-4a55-8d07-8632640b2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:13.853801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059e9e-1693-4a55-8d07-8632640b2eec None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:13.854260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059e9e-1693-4a55-8d07-8632640b2eec None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:13.854680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059e9e-1693-4a55-8d07-8632640b2eec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:13.920210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb8c78-23fd-4d0c-a7d5-f719243d9b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.922121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb8c78-23fd-4d0c-a7d5-f719243d9b9e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:13.954849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97059e9e-1693-4a55-8d07-8632640b2eec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:13.956609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97059e9e-1693-4a55-8d07-8632640b2eec None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:14.078403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 100/199] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:14.080327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb8c78-23fd-4d0c-a7d5-f719243d9b9e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:14.113248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 100/200] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:14.114892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059e9e-1693-4a55-8d07-8632640b2eec None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:14.132426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:14.153820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:14.203194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb8c78-23fd-4d0c-a7d5-f719243d9b9e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:14.252599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a4d64-b959-452b-a235-7dced813af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:14.253214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a4d64-b959-452b-a235-7dced813af89 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:14.253516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a4d64-b959-452b-a235-7dced813af89 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:14.253794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a4d64-b959-452b-a235-7dced813af89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:14.254514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a4d64-b959-452b-a235-7dced813af89 None admin] RBAC: Adding query filter params (role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=489c81caedde4f28b2a0fd979567a03e, user.id=ab79d473dce94574b1e4da104bc02e6b) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:14.254851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a4d64-b959-452b-a235-7dced813af89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:14.256911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a4d64-b959-452b-a235-7dced813af89 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:14.260946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059e9e-1693-4a55-8d07-8632640b2eec None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:14.266618 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 101/201] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:14 2022] GET /identity/v3/role_assignments?user.id=ab79d473dce94574b1e4da104bc02e6b&scope.project.id=489c81caedde4f28b2a0fd979567a03e&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:14.266618 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a4d64-b959-452b-a235-7dced813af89 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:14.344915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9a9f9-ea7b-40a6-a416-133bcafbd95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:14.346392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a9f9-ea7b-40a6-a416-133bcafbd95c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:14.347713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a9f9-ea7b-40a6-a416-133bcafbd95c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:14.350038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a9f9-ea7b-40a6-a416-133bcafbd95c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:14.452024 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a4d64-b959-452b-a235-7dced813af89 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:14.464030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:14.507094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1dc2-53cd-447e-925f-c16e9b32331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:14.508008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1dc2-53cd-447e-925f-c16e9b32331d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:14.508773 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1dc2-53cd-447e-925f-c16e9b32331d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:14.509964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1dc2-53cd-447e-925f-c16e9b32331d None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:14.512068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f1dc2-53cd-447e-925f-c16e9b32331d None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:14.514456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f1dc2-53cd-447e-925f-c16e9b32331d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:14.519254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 102/202] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:14 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:14.521308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1dc2-53cd-447e-925f-c16e9b32331d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:14.521471 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9a9f9-ea7b-40a6-a416-133bcafbd95c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:14.523021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9a9f9-ea7b-40a6-a416-133bcafbd95c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:14.560768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:14.687562 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1dc2-53cd-447e-925f-c16e9b32331d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:14.690708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 101/203] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:14.691698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9a9f9-ea7b-40a6-a416-133bcafbd95c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:14.740682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cddb3-1cf6-4754-9283-c62290bcc790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:14.741606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cddb3-1cf6-4754-9283-c62290bcc790 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:14.742049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cddb3-1cf6-4754-9283-c62290bcc790 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:14.742512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cddb3-1cf6-4754-9283-c62290bcc790 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:14.744232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cddb3-1cf6-4754-9283-c62290bcc790 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:14.746906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cddb3-1cf6-4754-9283-c62290bcc790 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:14.749026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 103/204] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:14 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:14.749986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cddb3-1cf6-4754-9283-c62290bcc790 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:14.812881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:14.854561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9a9f9-ea7b-40a6-a416-133bcafbd95c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:14.880412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:14.894345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4feee4-18d9-4cff-9205-a43bb72fd70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:14.895139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4feee4-18d9-4cff-9205-a43bb72fd70c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:14.895516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4feee4-18d9-4cff-9205-a43bb72fd70c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:14.895880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4feee4-18d9-4cff-9205-a43bb72fd70c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:14.896707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4feee4-18d9-4cff-9205-a43bb72fd70c None admin] RBAC: Adding query filter params (role.id=fcc7d8db3d7249f393782c75305077c2, scope.project.id=b0de385b20724662bfc182dd6a4c2641, user.id=943ef6b09f6840ed8c7596959f7c2ac3) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:14.897112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4feee4-18d9-4cff-9205-a43bb72fd70c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:14.898710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4feee4-18d9-4cff-9205-a43bb72fd70c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:14.901340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cddb3-1cf6-4754-9283-c62290bcc790 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:14.905411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 102/205] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:14 2022] GET /identity/v3/role_assignments?user.id=943ef6b09f6840ed8c7596959f7c2ac3&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=fcc7d8db3d7249f393782c75305077c2 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:14.911916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4feee4-18d9-4cff-9205-a43bb72fd70c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:14.973469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d6838-8698-4b8a-a430-64ba648514bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:14.974505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d6838-8698-4b8a-a430-64ba648514bf None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:14.975003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d6838-8698-4b8a-a430-64ba648514bf None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:14.975441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d6838-8698-4b8a-a430-64ba648514bf None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:14.976993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d6838-8698-4b8a-a430-64ba648514bf None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:14.979126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d6838-8698-4b8a-a430-64ba648514bf None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:14.981599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 104/206] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:14 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:14.990907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d6838-8698-4b8a-a430-64ba648514bf None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:15.137474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4feee4-18d9-4cff-9205-a43bb72fd70c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:15.185256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d6838-8698-4b8a-a430-64ba648514bf None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:15.190362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03a664-f10c-4bbb-bc01-7f4a7d75ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:15.191020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03a664-f10c-4bbb-bc01-7f4a7d75ed0c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:15.191367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03a664-f10c-4bbb-bc01-7f4a7d75ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:15.191649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03a664-f10c-4bbb-bc01-7f4a7d75ed0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:15.192409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03a664-f10c-4bbb-bc01-7f4a7d75ed0c None admin] RBAC: Adding query filter params (role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=f06373c3edbc40b1880f456b42cc666a, user.id=4f898d3ad145411fb6d01ea4688bbb21) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:15.192724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03a664-f10c-4bbb-bc01-7f4a7d75ed0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:15.194213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03a664-f10c-4bbb-bc01-7f4a7d75ed0c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:15.201161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:15.203812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 103/207] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:14 2022] GET /identity/v3/role_assignments?user.id=4f898d3ad145411fb6d01ea4688bbb21&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=40201003f53c4077b8e412e7d4450cab => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:15.240113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce77985-4bc2-4c00-b7e5-1c17bab3a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:15.241210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce77985-4bc2-4c00-b7e5-1c17bab3a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:15.241703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce77985-4bc2-4c00-b7e5-1c17bab3a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:15.242213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce77985-4bc2-4c00-b7e5-1c17bab3a7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:15.243254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce77985-4bc2-4c00-b7e5-1c17bab3a7b1 None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=f06373c3edbc40b1880f456b42cc666a, user.id=4f898d3ad145411fb6d01ea4688bbb21) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:15.243790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce77985-4bc2-4c00-b7e5-1c17bab3a7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:15.245593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce77985-4bc2-4c00-b7e5-1c17bab3a7b1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:15.252817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 105/208] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:14 2022] GET /identity/v3/role_assignments?user.id=4f898d3ad145411fb6d01ea4688bbb21&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:15.807410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d0bb-b443-4c71-83c9-4717f7b36ea3 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:15.808446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d0bb-b443-4c71-83c9-4717f7b36ea3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:15.809079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d0bb-b443-4c71-83c9-4717f7b36ea3 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:15.810832 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 104/209] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:15.817313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9abadb-67de-4ee1-b069-77a6b39e299b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:15.818180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9abadb-67de-4ee1-b069-77a6b39e299b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:15.818650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9abadb-67de-4ee1-b069-77a6b39e299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:15.832152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb834-6e91-4fdb-b2a9-accf607204d3 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:15.832759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb834-6e91-4fdb-b2a9-accf607204d3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:15.833288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb834-6e91-4fdb-b2a9-accf607204d3 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:15.835141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 105/210] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:15.838527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-bc9abadb-67de-4ee1-b069-77a6b39e299b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:15.839796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bc9abadb-67de-4ee1-b069-77a6b39e299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:15.840907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e66ba-d241-40f5-b20f-4115f15d3294 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:15.841393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e66ba-d241-40f5-b20f-4115f15d3294 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:15.841964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e66ba-d241-40f5-b20f-4115f15d3294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:15.860995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ec8e66ba-d241-40f5-b20f-4115f15d3294 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:15.862698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ec8e66ba-d241-40f5-b20f-4115f15d3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:15.918932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:15.920065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 106/211] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:15.952971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 106/212] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:16.190292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9abadb-67de-4ee1-b069-77a6b39e299b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:16.233334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e66ba-d241-40f5-b20f-4115f15d3294 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:16.307193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9abadb-67de-4ee1-b069-77a6b39e299b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:16.310398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:16.356520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be01bbc-c3b2-401a-a525-9f68178788f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:16.357181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be01bbc-c3b2-401a-a525-9f68178788f5 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:16.357461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be01bbc-c3b2-401a-a525-9f68178788f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:16.358143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be01bbc-c3b2-401a-a525-9f68178788f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:16.365289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e66ba-d241-40f5-b20f-4115f15d3294 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:16.371567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be01bbc-c3b2-401a-a525-9f68178788f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-0be01bbc-c3b2-401a-a525-9f68178788f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:16.377774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:16.378685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:16.379530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 107/213] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:16.386716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be01bbc-c3b2-401a-a525-9f68178788f5 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:16.415630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356996e-5810-465d-b686-3d73952f9f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:16.416684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356996e-5810-465d-b686-3d73952f9f6b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:16.417156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356996e-5810-465d-b686-3d73952f9f6b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:16.417616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356996e-5810-465d-b686-3d73952f9f6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:16.418957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356996e-5810-465d-b686-3d73952f9f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:16.420618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356996e-5810-465d-b686-3d73952f9f6b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:16.422800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 107/214] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:16.436053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356996e-5810-465d-b686-3d73952f9f6b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:16.503986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:16.525156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be01bbc-c3b2-401a-a525-9f68178788f5 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:16.572464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0eac2-67a0-45e7-97ac-0df1deb84463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:16.573082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0eac2-67a0-45e7-97ac-0df1deb84463 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:16.573364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0eac2-67a0-45e7-97ac-0df1deb84463 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:16.573637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0eac2-67a0-45e7-97ac-0df1deb84463 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:16.574302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0eac2-67a0-45e7-97ac-0df1deb84463 None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:16.574607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0eac2-67a0-45e7-97ac-0df1deb84463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:16.576016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0eac2-67a0-45e7-97ac-0df1deb84463 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:16.578421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356996e-5810-465d-b686-3d73952f9f6b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:16.594356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 108/215] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:16.596342 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0eac2-67a0-45e7-97ac-0df1deb84463 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:16.629731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e33dd5-b1c2-4f88-861f-86f524358e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:16.631286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e33dd5-b1c2-4f88-861f-86f524358e15 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:16.631789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e33dd5-b1c2-4f88-861f-86f524358e15 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:16.632274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e33dd5-b1c2-4f88-861f-86f524358e15 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:16.632493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:16.633503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e33dd5-b1c2-4f88-861f-86f524358e15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:16.636135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e33dd5-b1c2-4f88-861f-86f524358e15 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:16.663569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 108/216] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:16 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:16.731017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0eac2-67a0-45e7-97ac-0df1deb84463 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:16.772344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5e850-7c7d-467f-8f12-7b75cc943ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:16.773308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e850-7c7d-467f-8f12-7b75cc943ebd None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:16.773854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e850-7c7d-467f-8f12-7b75cc943ebd None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:16.774300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e850-7c7d-467f-8f12-7b75cc943ebd None admin] PATH_INFO: `/v3/users/106a4fb272244b4eb8522cbf1485faf6` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:16.792523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5e850-7c7d-467f-8f12-7b75cc943ebd None admin] RBAC: Authorizing `identity:get_user(user_id=106a4fb272244b4eb8522cbf1485faf6)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:16.794334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5e850-7c7d-467f-8f12-7b75cc943ebd None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:16.796745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 109/217] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:16 2022] GET /identity/v3/users/106a4fb272244b4eb8522cbf1485faf6 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:16.803823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e33dd5-b1c2-4f88-861f-86f524358e15 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:16.920824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e33dd5-b1c2-4f88-861f-86f524358e15 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:16.924993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:16.974419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daafc7-5227-420d-8f5a-1245d58df7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:16.975136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daafc7-5227-420d-8f5a-1245d58df7f0 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:16.975429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daafc7-5227-420d-8f5a-1245d58df7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:16.975709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daafc7-5227-420d-8f5a-1245d58df7f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:17.058345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daafc7-5227-420d-8f5a-1245d58df7f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:17.059786 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daafc7-5227-420d-8f5a-1245d58df7f0 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:17.183174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 109/218] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:17.190419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5e850-7c7d-467f-8f12-7b75cc943ebd None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:17.269260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f8034-8c15-4e45-971d-b73f5cd21b6f None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:17.269609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f8034-8c15-4e45-971d-b73f5cd21b6f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:17.269822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f8034-8c15-4e45-971d-b73f5cd21b6f None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:17.271614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 110/219] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:32:17.276997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a8a8-8877-4092-913d-3e7951529e7c None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:17.277281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a8a8-8877-4092-913d-3e7951529e7c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:17.277562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a8a8-8877-4092-913d-3e7951529e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:17.286130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:17.306302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-3199a8a8-8877-4092-913d-3e7951529e7c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:17.309424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3199a8a8-8877-4092-913d-3e7951529e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:17.320588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:17.339641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5e850-7c7d-467f-8f12-7b75cc943ebd None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:17.386837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57979b3c-0bd8-42b7-a11e-87d04409248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:17.386837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57979b3c-0bd8-42b7-a11e-87d04409248f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:17.386837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57979b3c-0bd8-42b7-a11e-87d04409248f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:17.386837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57979b3c-0bd8-42b7-a11e-87d04409248f None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:17.387248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57979b3c-0bd8-42b7-a11e-87d04409248f None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:17.387588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57979b3c-0bd8-42b7-a11e-87d04409248f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:17.390368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 110/220] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:17 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:17.392188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812469f-bca7-4616-84fe-f88f08da59b5 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:17.392623 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812469f-bca7-4616-84fe-f88f08da59b5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:17.392903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812469f-bca7-4616-84fe-f88f08da59b5 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:17.394451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 111/221] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:17.404261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d1f1-083e-401e-aa8f-4889bc4d43e2 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:17.404832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d1f1-083e-401e-aa8f-4889bc4d43e2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:17.405323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d1f1-083e-401e-aa8f-4889bc4d43e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:17.409910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 111/222] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:17.410817 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a8a8-8877-4092-913d-3e7951529e7c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:17.425538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4422d1f1-083e-401e-aa8f-4889bc4d43e2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:17.427195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4422d1f1-083e-401e-aa8f-4889bc4d43e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:17.501783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 112/223] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:17.539378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a8a8-8877-4092-913d-3e7951529e7c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:17.588558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7572-c0ed-41f1-8deb-332882a5fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:17.589100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7572-c0ed-41f1-8deb-332882a5fe8d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:17.589384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7572-c0ed-41f1-8deb-332882a5fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:17.589664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7572-c0ed-41f1-8deb-332882a5fe8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:17.590403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a7572-c0ed-41f1-8deb-332882a5fe8d None admin] RBAC: Adding query filter params (role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=f06373c3edbc40b1880f456b42cc666a, user.id=106a4fb272244b4eb8522cbf1485faf6) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:17.590715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a7572-c0ed-41f1-8deb-332882a5fe8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:17.592195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a7572-c0ed-41f1-8deb-332882a5fe8d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:17.594122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:17.603323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 112/224] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:17 2022] GET /identity/v3/role_assignments?user.id=106a4fb272244b4eb8522cbf1485faf6&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:17.831153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422d1f1-083e-401e-aa8f-4889bc4d43e2 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:17.881263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7572-c0ed-41f1-8deb-332882a5fe8d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:17.955218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:18.016769 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422d1f1-083e-401e-aa8f-4889bc4d43e2 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:18.044505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7572-c0ed-41f1-8deb-332882a5fe8d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:18.086519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d5412-ad69-40dd-924d-f00841e4a196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:18.087196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d5412-ad69-40dd-924d-f00841e4a196 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:18.087474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d5412-ad69-40dd-924d-f00841e4a196 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:18.087744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d5412-ad69-40dd-924d-f00841e4a196 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:18.109507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d5412-ad69-40dd-924d-f00841e4a196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-ef5d5412-ad69-40dd-924d-f00841e4a196 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:18.115164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:18.116028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:18.116811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:18.118167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 113/225] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:18.126794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d5412-ad69-40dd-924d-f00841e4a196 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:18.128204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceca3f-796c-44e6-844a-df01cdc776b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:18.128861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceca3f-796c-44e6-844a-df01cdc776b4 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:18.129139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceca3f-796c-44e6-844a-df01cdc776b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:18.129414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceca3f-796c-44e6-844a-df01cdc776b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:18.148835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aceca3f-796c-44e6-844a-df01cdc776b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-4aceca3f-796c-44e6-844a-df01cdc776b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:18.154069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:18.154948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:18.156143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 113/226] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:32:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:18.161857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceca3f-796c-44e6-844a-df01cdc776b4 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:18.265993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:18.316003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceca3f-796c-44e6-844a-df01cdc776b4 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:18.352705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14f659-ed05-42d6-8858-a2f4c312a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:18.353666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14f659-ed05-42d6-8858-a2f4c312a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:18.354139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14f659-ed05-42d6-8858-a2f4c312a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:18.354603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14f659-ed05-42d6-8858-a2f4c312a9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:18.354842 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d5412-ad69-40dd-924d-f00841e4a196 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:18.356044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14f659-ed05-42d6-8858-a2f4c312a9c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:18.356629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14f659-ed05-42d6-8858-a2f4c312a9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:18.358238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14f659-ed05-42d6-8858-a2f4c312a9c0 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:18.367393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 114/227] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:18.375733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14f659-ed05-42d6-8858-a2f4c312a9c0 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:18.425413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4325c-96ae-4d33-9187-274f40c51006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:18.426179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4325c-96ae-4d33-9187-274f40c51006 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:18.426462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4325c-96ae-4d33-9187-274f40c51006 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:18.426734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4325c-96ae-4d33-9187-274f40c51006 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:18.428301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4325c-96ae-4d33-9187-274f40c51006 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:18.428605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4325c-96ae-4d33-9187-274f40c51006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:18.429987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4325c-96ae-4d33-9187-274f40c51006 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:18.451136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 114/228] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:18.453322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4325c-96ae-4d33-9187-274f40c51006 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:18.471136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:18.576784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14f659-ed05-42d6-8858-a2f4c312a9c0 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:18.617693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:18.646206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bc03a-3cd8-4f6f-85a5-11754ed197aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:18.646867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bc03a-3cd8-4f6f-85a5-11754ed197aa None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:18.647206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bc03a-3cd8-4f6f-85a5-11754ed197aa None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:18.647480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bc03a-3cd8-4f6f-85a5-11754ed197aa None admin] PATH_INFO: `/v3/users/4f898d3ad145411fb6d01ea4688bbb21` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:18.649769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bc03a-3cd8-4f6f-85a5-11754ed197aa None admin] RBAC: Authorizing `identity:get_user(user_id=4f898d3ad145411fb6d01ea4688bbb21)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:18.653767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bc03a-3cd8-4f6f-85a5-11754ed197aa None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:18.656838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4325c-96ae-4d33-9187-274f40c51006 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:18.663294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 115/229] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:18 2022] GET /identity/v3/users/4f898d3ad145411fb6d01ea4688bbb21 => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:18.677310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bc03a-3cd8-4f6f-85a5-11754ed197aa None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:18.726943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180de59-60e9-47d1-a796-a94474c50d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:18.727991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180de59-60e9-47d1-a796-a94474c50d29 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:18.728268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180de59-60e9-47d1-a796-a94474c50d29 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:18.729225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180de59-60e9-47d1-a796-a94474c50d29 None admin] PATH_INFO: `/v3/users/4f898d3ad145411fb6d01ea4688bbb21` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:18.730529 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180de59-60e9-47d1-a796-a94474c50d29 None admin] RBAC: Authorizing `identity:get_user(user_id=4f898d3ad145411fb6d01ea4688bbb21)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:18.733106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180de59-60e9-47d1-a796-a94474c50d29 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:18.734704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 115/230] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:18 2022] GET /identity/v3/users/4f898d3ad145411fb6d01ea4688bbb21 => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:18.741628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180de59-60e9-47d1-a796-a94474c50d29 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:18.842210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bc03a-3cd8-4f6f-85a5-11754ed197aa None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:18.876686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:18.882801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae54d9-780f-4a02-a4c4-93c50a48e209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:18.882801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae54d9-780f-4a02-a4c4-93c50a48e209 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:18.882801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae54d9-780f-4a02-a4c4-93c50a48e209 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:18.882801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae54d9-780f-4a02-a4c4-93c50a48e209 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:18.885082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae54d9-780f-4a02-a4c4-93c50a48e209 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:18.886560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae54d9-780f-4a02-a4c4-93c50a48e209 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:18.889913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 116/231] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:18 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:18.899826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae54d9-780f-4a02-a4c4-93c50a48e209 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:18.918923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180de59-60e9-47d1-a796-a94474c50d29 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:18.957314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0bb9-655e-4750-a934-196468cd7d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:18.958230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0bb9-655e-4750-a934-196468cd7d36 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:18.958648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0bb9-655e-4750-a934-196468cd7d36 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:18.959081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0bb9-655e-4750-a934-196468cd7d36 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:18.960374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f0bb9-655e-4750-a934-196468cd7d36 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:18.961959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f0bb9-655e-4750-a934-196468cd7d36 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:18.963903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 116/232] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:18 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:18.973085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0bb9-655e-4750-a934-196468cd7d36 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:19.035868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:19.122497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae54d9-780f-4a02-a4c4-93c50a48e209 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:19.170704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0bb9-655e-4750-a934-196468cd7d36 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:19.185912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9e9ff-57da-4c65-87dd-2a9ba48c697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:19.186587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9e9ff-57da-4c65-87dd-2a9ba48c697e None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:19.186898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9e9ff-57da-4c65-87dd-2a9ba48c697e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:19.187173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9e9ff-57da-4c65-87dd-2a9ba48c697e None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a/users/4f898d3ad145411fb6d01ea4688bbb21/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:19.192020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9e9ff-57da-4c65-87dd-2a9ba48c697e None admin] RBAC: Authorizing `identity:create_grant(project_id=f06373c3edbc40b1880f456b42cc666a, user_id=4f898d3ad145411fb6d01ea4688bbb21, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:19.193541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9e9ff-57da-4c65-87dd-2a9ba48c697e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:19.214629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 117/233] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:32:18 2022] PUT /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a/users/4f898d3ad145411fb6d01ea4688bbb21/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:19.232149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58fa10-860a-4540-b16b-cc74f724ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:19.232833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58fa10-860a-4540-b16b-cc74f724ecc1 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:19.233118 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58fa10-860a-4540-b16b-cc74f724ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:19.233398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58fa10-860a-4540-b16b-cc74f724ecc1 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a/users/4f898d3ad145411fb6d01ea4688bbb21/roles/40201003f53c4077b8e412e7d4450cab` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:19.235846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58fa10-860a-4540-b16b-cc74f724ecc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f06373c3edbc40b1880f456b42cc666a, user_id=4f898d3ad145411fb6d01ea4688bbb21, role_id=40201003f53c4077b8e412e7d4450cab)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:19.238076 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58fa10-860a-4540-b16b-cc74f724ecc1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:19.250379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:19.260037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 117/234] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:32:18 2022] PUT /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a/users/4f898d3ad145411fb6d01ea4688bbb21/roles/40201003f53c4077b8e412e7d4450cab => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:19.269592 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3d40-b801-4496-b0e1-0bc0c32e8a2f None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:19.270173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3d40-b801-4496-b0e1-0bc0c32e8a2f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:19.270627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3d40-b801-4496-b0e1-0bc0c32e8a2f None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:19.272940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 118/235] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:19.279272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfe1aa-6338-42de-90e5-7851453d284b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:19.279911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfe1aa-6338-42de-90e5-7851453d284b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:19.280414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfe1aa-6338-42de-90e5-7851453d284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:19.289145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a60e0-8c35-499f-9023-8c5e8242e874 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:19.289456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a60e0-8c35-499f-9023-8c5e8242e874 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:19.289699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a60e0-8c35-499f-9023-8c5e8242e874 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:19.291168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 119/236] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:19.297247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235aec-06c7-46e7-bce9-60f189050020 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:19.297595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235aec-06c7-46e7-bce9-60f189050020 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:19.297875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235aec-06c7-46e7-bce9-60f189050020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:19.311684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5acfe1aa-6338-42de-90e5-7851453d284b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:19.313369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5acfe1aa-6338-42de-90e5-7851453d284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:19.318165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-72235aec-06c7-46e7-bce9-60f189050020 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:19.319416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-72235aec-06c7-46e7-bce9-60f189050020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:19.436857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 118/237] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:19.463890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 120/238] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:19.735300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfe1aa-6338-42de-90e5-7851453d284b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:19.828296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dc734-95d1-4b66-a60b-3321b7309ae1 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:19.828921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dc734-95d1-4b66-a60b-3321b7309ae1 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:19.829983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dc734-95d1-4b66-a60b-3321b7309ae1 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:19.831605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 121/239] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:19.846368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dc734-95d1-4b66-a60b-3321b7309ae1 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:19.868247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfe1aa-6338-42de-90e5-7851453d284b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:19.904098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:19.910159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8c9d9-d683-473b-9275-44099dcc8fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:19.910840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8c9d9-d683-473b-9275-44099dcc8fad None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:19.911345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8c9d9-d683-473b-9275-44099dcc8fad None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:19.911617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8c9d9-d683-473b-9275-44099dcc8fad None admin] PATH_INFO: `/v3/domains/default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:19.912902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8c9d9-d683-473b-9275-44099dcc8fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:19.913723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:19.915423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8c9d9-d683-473b-9275-44099dcc8fad None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:19.917431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 119/240] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:19.918993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1827-5117-48b5-ab64-20c9c977c474 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:19.919273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1827-5117-48b5-ab64-20c9c977c474 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:19.919543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a1827-5117-48b5-ab64-20c9c977c474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:19.950368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d05a1827-5117-48b5-ab64-20c9c977c474 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:19.951777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d05a1827-5117-48b5-ab64-20c9c977c474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:19.977041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dc734-95d1-4b66-a60b-3321b7309ae1 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:20.018479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc452c-0869-4a5d-b25f-58ca7f3b8c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:20.019164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc452c-0869-4a5d-b25f-58ca7f3b8c44 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:20.019515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc452c-0869-4a5d-b25f-58ca7f3b8c44 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:20.019864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc452c-0869-4a5d-b25f-58ca7f3b8c44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:20.023360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 120/241] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:20.031684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc452c-0869-4a5d-b25f-58ca7f3b8c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:20.031859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a1827-5117-48b5-ab64-20c9c977c474 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-3fcc452c-0869-4a5d-b25f-58ca7f3b8c44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:20.037295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:20.038215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:20.039553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 122/242] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:20.048035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc452c-0869-4a5d-b25f-58ca7f3b8c44 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:20.171474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc452c-0869-4a5d-b25f-58ca7f3b8c44 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:20.201474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:20.241782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab33a7-08c1-400a-9894-562bc83c291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:20.242537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab33a7-08c1-400a-9894-562bc83c291a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:20.242841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab33a7-08c1-400a-9894-562bc83c291a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:20.243124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab33a7-08c1-400a-9894-562bc83c291a None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:20.243795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab33a7-08c1-400a-9894-562bc83c291a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:20.244101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab33a7-08c1-400a-9894-562bc83c291a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:20.247893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab33a7-08c1-400a-9894-562bc83c291a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:20.253619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a1827-5117-48b5-ab64-20c9c977c474 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:20.262666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 123/243] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:20.268391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab33a7-08c1-400a-9894-562bc83c291a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:20.289058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:20.302958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef4199-27db-4d43-85ff-ffb032a7bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:20.305016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef4199-27db-4d43-85ff-ffb032a7bf9b None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:20.305303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef4199-27db-4d43-85ff-ffb032a7bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:20.305579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef4199-27db-4d43-85ff-ffb032a7bf9b None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:20.307168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef4199-27db-4d43-85ff-ffb032a7bf9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:20.310176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef4199-27db-4d43-85ff-ffb032a7bf9b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:20.345985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 121/244] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:20 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:20.402934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef4199-27db-4d43-85ff-ffb032a7bf9b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:20.417083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab33a7-08c1-400a-9894-562bc83c291a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:20.471813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ee1f8-f3d8-42e7-9121-1abcd06ad5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:20.472478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee1f8-f3d8-42e7-9121-1abcd06ad5ac None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:20.475196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee1f8-f3d8-42e7-9121-1abcd06ad5ac None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:20.475532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee1f8-f3d8-42e7-9121-1abcd06ad5ac None admin] PATH_INFO: `/v3/users/5eba8ccba25c424ba45279a379f9fc6c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:20.513722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ee1f8-f3d8-42e7-9121-1abcd06ad5ac None admin] RBAC: Authorizing `identity:get_user(user_id=5eba8ccba25c424ba45279a379f9fc6c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:20.515274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ee1f8-f3d8-42e7-9121-1abcd06ad5ac None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:20.517824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 124/245] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:20 2022] GET /identity/v3/users/5eba8ccba25c424ba45279a379f9fc6c => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:20.524134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ee1f8-f3d8-42e7-9121-1abcd06ad5ac None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:20.560347 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:20.586576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef4199-27db-4d43-85ff-ffb032a7bf9b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:20.628574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187d25-7696-41ba-a874-e2e058946749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:20.629689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187d25-7696-41ba-a874-e2e058946749 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:20.630172 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187d25-7696-41ba-a874-e2e058946749 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:20.630644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187d25-7696-41ba-a874-e2e058946749 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:20.643776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82187d25-7696-41ba-a874-e2e058946749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-82187d25-7696-41ba-a874-e2e058946749 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:20.650246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:20.651198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:20.652067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:20.660597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ee1f8-f3d8-42e7-9121-1abcd06ad5ac None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:20.661503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 122/246] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:20.662707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187d25-7696-41ba-a874-e2e058946749 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:20.697910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff5da7-a22c-49d7-86a8-59afa127a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:20.698528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5da7-a22c-49d7-86a8-59afa127a778 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:20.698834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5da7-a22c-49d7-86a8-59afa127a778 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:20.699134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5da7-a22c-49d7-86a8-59afa127a778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:20.718027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:20.787113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff5da7-a22c-49d7-86a8-59afa127a778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:20.788262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187d25-7696-41ba-a874-e2e058946749 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:20.788590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff5da7-a22c-49d7-86a8-59afa127a778 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:20.818717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:20.831379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256a629-3125-437b-afde-78e09ea0d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:20.832324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256a629-3125-437b-afde-78e09ea0d64f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:20.832835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256a629-3125-437b-afde-78e09ea0d64f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:20.833304 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256a629-3125-437b-afde-78e09ea0d64f None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:20.834177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256a629-3125-437b-afde-78e09ea0d64f None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:20.834677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256a629-3125-437b-afde-78e09ea0d64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:20.836284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256a629-3125-437b-afde-78e09ea0d64f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:20.846801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 123/247] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:20.852868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256a629-3125-437b-afde-78e09ea0d64f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:20.906797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 125/248] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:20.912212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff5da7-a22c-49d7-86a8-59afa127a778 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:20.993932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256a629-3125-437b-afde-78e09ea0d64f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:21.003483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:21.037537 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd8e06-296e-4911-a58a-49ee196e1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:21.038694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd8e06-296e-4911-a58a-49ee196e1519 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:21.039349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd8e06-296e-4911-a58a-49ee196e1519 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:21.039921 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd8e06-296e-4911-a58a-49ee196e1519 None admin] PATH_INFO: `/v3/users/106a4fb272244b4eb8522cbf1485faf6` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:21.041781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd8e06-296e-4911-a58a-49ee196e1519 None admin] RBAC: Authorizing `identity:get_user(user_id=106a4fb272244b4eb8522cbf1485faf6)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:21.043736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd8e06-296e-4911-a58a-49ee196e1519 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:21.046535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 124/249] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:20 2022] GET /identity/v3/users/106a4fb272244b4eb8522cbf1485faf6 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:21.053343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd8e06-296e-4911-a58a-49ee196e1519 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:21.076073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff5da7-a22c-49d7-86a8-59afa127a778 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:21.110228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:21.123612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63787a1e-bf2e-451d-9a95-f6af011676eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:21.124269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63787a1e-bf2e-451d-9a95-f6af011676eb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:21.124553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63787a1e-bf2e-451d-9a95-f6af011676eb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:21.124827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63787a1e-bf2e-451d-9a95-f6af011676eb None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:21.126017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63787a1e-bf2e-451d-9a95-f6af011676eb None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:21.129027 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63787a1e-bf2e-451d-9a95-f6af011676eb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:21.131129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 126/250] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:20 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:21.141664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63787a1e-bf2e-451d-9a95-f6af011676eb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:21.189941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd8e06-296e-4911-a58a-49ee196e1519 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:21.231495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcee02-71d4-496f-89df-18af067e622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:21.232498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcee02-71d4-496f-89df-18af067e622b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:21.232977 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcee02-71d4-496f-89df-18af067e622b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:21.233484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcee02-71d4-496f-89df-18af067e622b None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:21.234871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcee02-71d4-496f-89df-18af067e622b None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:21.237495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcee02-71d4-496f-89df-18af067e622b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:21.239500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 125/251] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:21 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:21.245868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcee02-71d4-496f-89df-18af067e622b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:21.265986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63787a1e-bf2e-451d-9a95-f6af011676eb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:21.300250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:21.308870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3b05d-b5b2-4fcc-b129-73c2550bc534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:21.309524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3b05d-b5b2-4fcc-b129-73c2550bc534 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:21.309854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3b05d-b5b2-4fcc-b129-73c2550bc534 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:21.310157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3b05d-b5b2-4fcc-b129-73c2550bc534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:21.311099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3b05d-b5b2-4fcc-b129-73c2550bc534 None admin] RBAC: Adding query filter params (role.id=fcc7d8db3d7249f393782c75305077c2, scope.project.id=f06373c3edbc40b1880f456b42cc666a, user.id=5eba8ccba25c424ba45279a379f9fc6c) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:21.311421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3b05d-b5b2-4fcc-b129-73c2550bc534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:21.312893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3b05d-b5b2-4fcc-b129-73c2550bc534 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:21.319560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 127/252] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:21 2022] GET /identity/v3/role_assignments?user.id=5eba8ccba25c424ba45279a379f9fc6c&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=fcc7d8db3d7249f393782c75305077c2 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:21.376266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcee02-71d4-496f-89df-18af067e622b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:21.419370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69de6cb-85fe-4886-9cd5-b289fd4263c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:21.420454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69de6cb-85fe-4886-9cd5-b289fd4263c6 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:21.420937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69de6cb-85fe-4886-9cd5-b289fd4263c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:21.421411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69de6cb-85fe-4886-9cd5-b289fd4263c6 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a/users/106a4fb272244b4eb8522cbf1485faf6/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:21.424314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69de6cb-85fe-4886-9cd5-b289fd4263c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f06373c3edbc40b1880f456b42cc666a, user_id=106a4fb272244b4eb8522cbf1485faf6, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:21.426137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69de6cb-85fe-4886-9cd5-b289fd4263c6 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:21.443130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 126/253] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:32:21 2022] PUT /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a/users/106a4fb272244b4eb8522cbf1485faf6/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:21.733603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ee4b7-3dfa-4491-a6f0-de7079aa8f3f None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:21.733888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ee4b7-3dfa-4491-a6f0-de7079aa8f3f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:21.734190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ee4b7-3dfa-4491-a6f0-de7079aa8f3f None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:21.736517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 128/254] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:21.742282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442231f4-4a8f-464d-a580-b2e7f6bca1c4 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:21.742735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442231f4-4a8f-464d-a580-b2e7f6bca1c4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:21.742970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442231f4-4a8f-464d-a580-b2e7f6bca1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:21.771851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-442231f4-4a8f-464d-a580-b2e7f6bca1c4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:21.773066 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-442231f4-4a8f-464d-a580-b2e7f6bca1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:21.845975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 127/255] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:22.007092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a1b89-7904-4751-8788-35118fb2662b None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:22.007590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a1b89-7904-4751-8788-35118fb2662b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:22.008106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a1b89-7904-4751-8788-35118fb2662b None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:22.010948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 129/256] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:22.016168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d198241-a4f1-4d74-8473-34d27c5a1449 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:22.016552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d198241-a4f1-4d74-8473-34d27c5a1449 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:22.017151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d198241-a4f1-4d74-8473-34d27c5a1449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:22.043847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-9d198241-a4f1-4d74-8473-34d27c5a1449 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:22.045130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9d198241-a4f1-4d74-8473-34d27c5a1449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:22.076472 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:22.125496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 128/257] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:22.396082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a1b89-7904-4751-8788-35118fb2662b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:22.458427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:22.516025 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a1b89-7904-4751-8788-35118fb2662b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:22.557109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e838-db55-43c4-a4c1-99de8f8d405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:22.557746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e838-db55-43c4-a4c1-99de8f8d405e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:22.558021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e838-db55-43c4-a4c1-99de8f8d405e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:22.558291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e838-db55-43c4-a4c1-99de8f8d405e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:22.575609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8e838-db55-43c4-a4c1-99de8f8d405e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-6ed8e838-db55-43c4-a4c1-99de8f8d405e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:22.581464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:22.582332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:22.583179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:22.584302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 130/258] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:22.588745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d198241-a4f1-4d74-8473-34d27c5a1449 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:22.611609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e838-db55-43c4-a4c1-99de8f8d405e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:22.725144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e838-db55-43c4-a4c1-99de8f8d405e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:22.744696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:22.764877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e4087-e6b6-4f84-a883-dff7eb01fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:22.765904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e4087-e6b6-4f84-a883-dff7eb01fa4e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:22.766383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e4087-e6b6-4f84-a883-dff7eb01fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:22.767426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e4087-e6b6-4f84-a883-dff7eb01fa4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:22.779075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e4087-e6b6-4f84-a883-dff7eb01fa4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-229e4087-e6b6-4f84-a883-dff7eb01fa4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:22.785564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:22.786446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:22.787250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:22.789822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 131/259] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:22.795832 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e4087-e6b6-4f84-a883-dff7eb01fa4e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:22.861668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d198241-a4f1-4d74-8473-34d27c5a1449 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:22.944487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e4087-e6b6-4f84-a883-dff7eb01fa4e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:22.976476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fdff0-f3b4-4909-8969-3a6db2256c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:22.976661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fdff0-f3b4-4909-8969-3a6db2256c48 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:22.976907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fdff0-f3b4-4909-8969-3a6db2256c48 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:22.977260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fdff0-f3b4-4909-8969-3a6db2256c48 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:22.977854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fdff0-f3b4-4909-8969-3a6db2256c48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:22.978160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fdff0-f3b4-4909-8969-3a6db2256c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:22.979606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fdff0-f3b4-4909-8969-3a6db2256c48 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:22.994081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 129/260] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:22.999364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fdff0-f3b4-4909-8969-3a6db2256c48 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:23.023478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e26dbf-01fb-45e5-8dac-73d265e79807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:23.024102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e26dbf-01fb-45e5-8dac-73d265e79807 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:23.024395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e26dbf-01fb-45e5-8dac-73d265e79807 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:23.024699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e26dbf-01fb-45e5-8dac-73d265e79807 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:23.025349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e26dbf-01fb-45e5-8dac-73d265e79807 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:23.025654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e26dbf-01fb-45e5-8dac-73d265e79807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:23.027100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e26dbf-01fb-45e5-8dac-73d265e79807 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:23.040224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:23.042010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 132/261] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:23.048621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e26dbf-01fb-45e5-8dac-73d265e79807 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:23.154378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fdff0-f3b4-4909-8969-3a6db2256c48 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:23.166436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:23.224059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eba685-cb84-47d0-b3eb-4aea6eeb2ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:23.224762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eba685-cb84-47d0-b3eb-4aea6eeb2ca0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:23.224983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eba685-cb84-47d0-b3eb-4aea6eeb2ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:23.225249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eba685-cb84-47d0-b3eb-4aea6eeb2ca0 None admin] PATH_INFO: `/v3/users/4f898d3ad145411fb6d01ea4688bbb21` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:23.226403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eba685-cb84-47d0-b3eb-4aea6eeb2ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=4f898d3ad145411fb6d01ea4688bbb21)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:23.227916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eba685-cb84-47d0-b3eb-4aea6eeb2ca0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:23.229750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 130/262] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:22 2022] GET /identity/v3/users/4f898d3ad145411fb6d01ea4688bbb21 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:23.235064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eba685-cb84-47d0-b3eb-4aea6eeb2ca0 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:23.332745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e26dbf-01fb-45e5-8dac-73d265e79807 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:23.406927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:23.424467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eba685-cb84-47d0-b3eb-4aea6eeb2ca0 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:23.433130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b95f9-530c-4d3e-adbc-23cac2b3cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:23.433800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b95f9-530c-4d3e-adbc-23cac2b3cea8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:23.434071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b95f9-530c-4d3e-adbc-23cac2b3cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:23.434348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b95f9-530c-4d3e-adbc-23cac2b3cea8 None admin] PATH_INFO: `/v3/users/4f898d3ad145411fb6d01ea4688bbb21` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:23.440223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b95f9-530c-4d3e-adbc-23cac2b3cea8 None admin] RBAC: Authorizing `identity:get_user(user_id=4f898d3ad145411fb6d01ea4688bbb21)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:23.441846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b95f9-530c-4d3e-adbc-23cac2b3cea8 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:23.443910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 133/263] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:23 2022] GET /identity/v3/users/4f898d3ad145411fb6d01ea4688bbb21 => generated 283 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:23.451334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b95f9-530c-4d3e-adbc-23cac2b3cea8 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:23.493632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548133-5fd0-415f-a688-ee27a4bece01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:23.494605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548133-5fd0-415f-a688-ee27a4bece01 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:23.495105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548133-5fd0-415f-a688-ee27a4bece01 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:23.495631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548133-5fd0-415f-a688-ee27a4bece01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:23.631734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e548133-5fd0-415f-a688-ee27a4bece01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:23.633226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b95f9-530c-4d3e-adbc-23cac2b3cea8 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:23.633891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e548133-5fd0-415f-a688-ee27a4bece01 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:23.646636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:23.695663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d05b27-131d-4114-8b69-388f09a7a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:23.696310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d05b27-131d-4114-8b69-388f09a7a445 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:23.696565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d05b27-131d-4114-8b69-388f09a7a445 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:23.696834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d05b27-131d-4114-8b69-388f09a7a445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:23.799212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:23.813777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 131/264] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:23.822797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548133-5fd0-415f-a688-ee27a4bece01 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:23.872856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d05b27-131d-4114-8b69-388f09a7a445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:23.874371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d05b27-131d-4114-8b69-388f09a7a445 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:24.042509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 134/265] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:24.043897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4867f-ad52-45b4-803b-203cfb9d845c None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.044176 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4867f-ad52-45b4-803b-203cfb9d845c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.044444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4867f-ad52-45b4-803b-203cfb9d845c None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.045763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 135/266] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:24.046468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4867f-ad52-45b4-803b-203cfb9d845c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:24.072409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:24.076344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548133-5fd0-415f-a688-ee27a4bece01 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:24.120292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94044f48-fe6e-4a07-a569-c80d9830a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:24.120931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044f48-fe6e-4a07-a569-c80d9830a410 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.121208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044f48-fe6e-4a07-a569-c80d9830a410 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.121475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044f48-fe6e-4a07-a569-c80d9830a410 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.123146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94044f48-fe6e-4a07-a569-c80d9830a410 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:24.124852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94044f48-fe6e-4a07-a569-c80d9830a410 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:24.127899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 132/267] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:23 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:24.129749 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099955b-93de-48b0-bbad-cfec672e3bbe None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.130035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099955b-93de-48b0-bbad-cfec672e3bbe None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.130570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099955b-93de-48b0-bbad-cfec672e3bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.153756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c099955b-93de-48b0-bbad-cfec672e3bbe None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:24.154982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c099955b-93de-48b0-bbad-cfec672e3bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:24.175363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4867f-ad52-45b4-803b-203cfb9d845c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:24.211651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1fcc5-8564-4184-9b70-7bf2cff2a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:24.212624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1fcc5-8564-4184-9b70-7bf2cff2a32f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.212900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1fcc5-8564-4184-9b70-7bf2cff2a32f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.213170 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1fcc5-8564-4184-9b70-7bf2cff2a32f None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.214358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1fcc5-8564-4184-9b70-7bf2cff2a32f None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:24.215848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1fcc5-8564-4184-9b70-7bf2cff2a32f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:24.222905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 136/268] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:24 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:24.222905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663305db-4aa9-4c4a-a1a3-2a7ace5cee70 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.222905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663305db-4aa9-4c4a-a1a3-2a7ace5cee70 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.222905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663305db-4aa9-4c4a-a1a3-2a7ace5cee70 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.222905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 137/269] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:24.222905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663305db-4aa9-4c4a-a1a3-2a7ace5cee70 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:24.227959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:24.240836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 133/270] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:24.242082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d6bcd-e2c5-4ea5-8f46-d5c011491540 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.242370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d6bcd-e2c5-4ea5-8f46-d5c011491540 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.242630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d6bcd-e2c5-4ea5-8f46-d5c011491540 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.248130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 134/271] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:24.248130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d6bcd-e2c5-4ea5-8f46-d5c011491540 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:24.339704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:24.368495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d6bcd-e2c5-4ea5-8f46-d5c011491540 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:24.370903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663305db-4aa9-4c4a-a1a3-2a7ace5cee70 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:24.409256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ba3d9-9f41-48ed-b0b8-15a1b419dd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:24.409791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f7142-2f95-44dd-8f43-60b12f2731ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:24.409906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ba3d9-9f41-48ed-b0b8-15a1b419dd5b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.410125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ba3d9-9f41-48ed-b0b8-15a1b419dd5b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.410397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ba3d9-9f41-48ed-b0b8-15a1b419dd5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.410489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f7142-2f95-44dd-8f43-60b12f2731ca None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.410674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f7142-2f95-44dd-8f43-60b12f2731ca None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.410975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f7142-2f95-44dd-8f43-60b12f2731ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.411150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ba3d9-9f41-48ed-b0b8-15a1b419dd5b None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=f06373c3edbc40b1880f456b42cc666a, user.id=4f898d3ad145411fb6d01ea4688bbb21) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:24.411459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ba3d9-9f41-48ed-b0b8-15a1b419dd5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:24.411702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f7142-2f95-44dd-8f43-60b12f2731ca None admin] RBAC: Adding query filter params (role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=f06373c3edbc40b1880f456b42cc666a, user.id=4f898d3ad145411fb6d01ea4688bbb21) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:24.412009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f7142-2f95-44dd-8f43-60b12f2731ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:24.412898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ba3d9-9f41-48ed-b0b8-15a1b419dd5b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:24.413435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f7142-2f95-44dd-8f43-60b12f2731ca None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:24.419508 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 138/272] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:24 2022] GET /identity/v3/role_assignments?user.id=4f898d3ad145411fb6d01ea4688bbb21&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:24.419644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 135/273] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:24 2022] GET /identity/v3/role_assignments?user.id=4f898d3ad145411fb6d01ea4688bbb21&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=40201003f53c4077b8e412e7d4450cab => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:24.420841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf20f8-825d-4fc8-a117-e2bbcbfa34fb None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.421134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf20f8-825d-4fc8-a117-e2bbcbfa34fb None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.421407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf20f8-825d-4fc8-a117-e2bbcbfa34fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.429807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640f1a-25ad-4528-b411-cb1b012a67d8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.429807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640f1a-25ad-4528-b411-cb1b012a67d8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.429807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640f1a-25ad-4528-b411-cb1b012a67d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.456395 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-25bf20f8-825d-4fc8-a117-e2bbcbfa34fb None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:24.457893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-25bf20f8-825d-4fc8-a117-e2bbcbfa34fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:24.477763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-eb640f1a-25ad-4528-b411-cb1b012a67d8 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:24.479886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-eb640f1a-25ad-4528-b411-cb1b012a67d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:24.527238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:24.544641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 136/274] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:24.546412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f7122-0080-4e0e-bb3e-ed287189ac00 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.546797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f7122-0080-4e0e-bb3e-ed287189ac00 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.547164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f7122-0080-4e0e-bb3e-ed287189ac00 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.549411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 137/275] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:24.550259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f7122-0080-4e0e-bb3e-ed287189ac00 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:24.620313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 139/276] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:24.622120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eefab6-45e7-49e4-8a33-5648c0abeea1 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.622472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eefab6-45e7-49e4-8a33-5648c0abeea1 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.626862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eefab6-45e7-49e4-8a33-5648c0abeea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.654758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-74eefab6-45e7-49e4-8a33-5648c0abeea1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:24.657262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-74eefab6-45e7-49e4-8a33-5648c0abeea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:24.710264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f7122-0080-4e0e-bb3e-ed287189ac00 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:24.745760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:24.755504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 140/277] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:24.762161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca150-19f6-4e7c-b191-55b12e7a4b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:24.762892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca150-19f6-4e7c-b191-55b12e7a4b66 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.763224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca150-19f6-4e7c-b191-55b12e7a4b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.763499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca150-19f6-4e7c-b191-55b12e7a4b66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.777682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ca150-19f6-4e7c-b191-55b12e7a4b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-291ca150-19f6-4e7c-b191-55b12e7a4b66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:24.782691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:24.783712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:24.784571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 138/278] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:24.792217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eefab6-45e7-49e4-8a33-5648c0abeea1 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:24.902836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca150-19f6-4e7c-b191-55b12e7a4b66 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:24.912752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eefab6-45e7-49e4-8a33-5648c0abeea1 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:24.964737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7d839-760a-40ab-8775-2f8eaf2abe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:24.965404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7d839-760a-40ab-8775-2f8eaf2abe51 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:24.965687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7d839-760a-40ab-8775-2f8eaf2abe51 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:24.965957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7d839-760a-40ab-8775-2f8eaf2abe51 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:24.966619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7d839-760a-40ab-8775-2f8eaf2abe51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:24.966949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7d839-760a-40ab-8775-2f8eaf2abe51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:24.968415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7d839-760a-40ab-8775-2f8eaf2abe51 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:24.975166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:24.978190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 141/279] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:24.979084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7d839-760a-40ab-8775-2f8eaf2abe51 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.040216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca150-19f6-4e7c-b191-55b12e7a4b66 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.054093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:25.077084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e0c5f-9d88-4f43-a636-accec0df99ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.077880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e0c5f-9d88-4f43-a636-accec0df99ac None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.078238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e0c5f-9d88-4f43-a636-accec0df99ac None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.078517 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e0c5f-9d88-4f43-a636-accec0df99ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.090559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e0c5f-9d88-4f43-a636-accec0df99ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-d26e0c5f-9d88-4f43-a636-accec0df99ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:25.096760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:25.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:25.098450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 139/280] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:25.099143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7d839-760a-40ab-8775-2f8eaf2abe51 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.099213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e0c5f-9d88-4f43-a636-accec0df99ac None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.134576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8d11-e1b0-4dba-af3d-4fe313195c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.135227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8d11-e1b0-4dba-af3d-4fe313195c71 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.135505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8d11-e1b0-4dba-af3d-4fe313195c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.135778 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8d11-e1b0-4dba-af3d-4fe313195c71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.136871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8d11-e1b0-4dba-af3d-4fe313195c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:25.138316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8d11-e1b0-4dba-af3d-4fe313195c71 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:25.139916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 142/281] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:25.140665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8d11-e1b0-4dba-af3d-4fe313195c71 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.205549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e0c5f-9d88-4f43-a636-accec0df99ac None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.207769 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:25.240071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfade318-eb1f-49ef-a51e-75e25c1f294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.240709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfade318-eb1f-49ef-a51e-75e25c1f294e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.240995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfade318-eb1f-49ef-a51e-75e25c1f294e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.241266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfade318-eb1f-49ef-a51e-75e25c1f294e None admin] PATH_INFO: `/v3/users/5eba8ccba25c424ba45279a379f9fc6c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.242393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfade318-eb1f-49ef-a51e-75e25c1f294e None admin] RBAC: Authorizing `identity:get_user(user_id=5eba8ccba25c424ba45279a379f9fc6c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:25.243864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfade318-eb1f-49ef-a51e-75e25c1f294e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:25.244220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8d11-e1b0-4dba-af3d-4fe313195c71 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.250124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 140/282] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:25 2022] GET /identity/v3/users/5eba8ccba25c424ba45279a379f9fc6c => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:25.250124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfade318-eb1f-49ef-a51e-75e25c1f294e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.274475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:25.281171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a001ad0-fa47-45ed-b8d9-273b9898c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.281804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a001ad0-fa47-45ed-b8d9-273b9898c5ab None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.282070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a001ad0-fa47-45ed-b8d9-273b9898c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.282340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a001ad0-fa47-45ed-b8d9-273b9898c5ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.294502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a001ad0-fa47-45ed-b8d9-273b9898c5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-9a001ad0-fa47-45ed-b8d9-273b9898c5ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:25.299782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:25.300872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:25.301703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 143/283] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:25.302353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a001ad0-fa47-45ed-b8d9-273b9898c5ab None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.358564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfade318-eb1f-49ef-a51e-75e25c1f294e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.397236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9b9b3-e3fe-44c1-b442-e1538b98e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.397875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9b9b3-e3fe-44c1-b442-e1538b98e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.398154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9b9b3-e3fe-44c1-b442-e1538b98e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.398426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9b9b3-e3fe-44c1-b442-e1538b98e8c3 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.399125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9b9b3-e3fe-44c1-b442-e1538b98e8c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:25.399428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9b9b3-e3fe-44c1-b442-e1538b98e8c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:25.401188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9b9b3-e3fe-44c1-b442-e1538b98e8c3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:25.405978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a001ad0-fa47-45ed-b8d9-273b9898c5ab None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.412150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 141/284] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:25.412150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9b9b3-e3fe-44c1-b442-e1538b98e8c3 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.444116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c03a2b-65ab-4811-be38-5e79eeac4438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.444729 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c03a2b-65ab-4811-be38-5e79eeac4438 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.445000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c03a2b-65ab-4811-be38-5e79eeac4438 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.445274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c03a2b-65ab-4811-be38-5e79eeac4438 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.445922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c03a2b-65ab-4811-be38-5e79eeac4438 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:25.447380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c03a2b-65ab-4811-be38-5e79eeac4438 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:25.454346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:25.471119 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 144/285] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:25 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:25.472087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c03a2b-65ab-4811-be38-5e79eeac4438 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.536438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:25.550216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9b9b3-e3fe-44c1-b442-e1538b98e8c3 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.591206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d7d74-c4c8-41d5-b6d4-3df02950829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.591954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d7d74-c4c8-41d5-b6d4-3df02950829f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.592372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d7d74-c4c8-41d5-b6d4-3df02950829f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.592528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d7d74-c4c8-41d5-b6d4-3df02950829f None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.593714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d7d74-c4c8-41d5-b6d4-3df02950829f None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:25.596065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d7d74-c4c8-41d5-b6d4-3df02950829f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:25.598391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 142/286] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:25 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:25.599159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d7d74-c4c8-41d5-b6d4-3df02950829f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.605354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c03a2b-65ab-4811-be38-5e79eeac4438 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.652637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6cefa-c854-43c5-a955-ab7cef0ac578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.652637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6cefa-c854-43c5-a955-ab7cef0ac578 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.652929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6cefa-c854-43c5-a955-ab7cef0ac578 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.653167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6cefa-c854-43c5-a955-ab7cef0ac578 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.653759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6cefa-c854-43c5-a955-ab7cef0ac578 None admin] RBAC: Adding query filter params (name=member) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:25.654060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6cefa-c854-43c5-a955-ab7cef0ac578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:25.655471 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6cefa-c854-43c5-a955-ab7cef0ac578 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:25.665881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 145/287] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:25.666828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6cefa-c854-43c5-a955-ab7cef0ac578 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.727113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d7d74-c4c8-41d5-b6d4-3df02950829f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.730404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:25.775707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9d942-bd8d-4441-ba8e-6e4d6800672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.776383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9d942-bd8d-4441-ba8e-6e4d6800672b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.776710 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9d942-bd8d-4441-ba8e-6e4d6800672b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.776990 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9d942-bd8d-4441-ba8e-6e4d6800672b None admin] PATH_INFO: `/v3/users/106a4fb272244b4eb8522cbf1485faf6` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.778202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9d942-bd8d-4441-ba8e-6e4d6800672b None admin] RBAC: Authorizing `identity:get_user(user_id=106a4fb272244b4eb8522cbf1485faf6)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:25.779712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9d942-bd8d-4441-ba8e-6e4d6800672b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:25.781375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 143/288] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:25 2022] GET /identity/v3/users/106a4fb272244b4eb8522cbf1485faf6 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:25.782165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9d942-bd8d-4441-ba8e-6e4d6800672b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.796129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6cefa-c854-43c5-a955-ab7cef0ac578 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.810636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:25.854577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b046e-9fae-454b-9ea5-c6838f914436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.855266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b046e-9fae-454b-9ea5-c6838f914436 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.855546 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b046e-9fae-454b-9ea5-c6838f914436 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.855830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b046e-9fae-454b-9ea5-c6838f914436 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a/users/5eba8ccba25c424ba45279a379f9fc6c/roles/fcc7d8db3d7249f393782c75305077c2` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.858820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b046e-9fae-454b-9ea5-c6838f914436 None admin] RBAC: Authorizing `identity:create_grant(project_id=f06373c3edbc40b1880f456b42cc666a, user_id=5eba8ccba25c424ba45279a379f9fc6c, role_id=fcc7d8db3d7249f393782c75305077c2)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:25.860299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b046e-9fae-454b-9ea5-c6838f914436 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:25.878740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 146/289] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:32:25 2022] PUT /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a/users/5eba8ccba25c424ba45279a379f9fc6c/roles/fcc7d8db3d7249f393782c75305077c2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:25.879750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b046e-9fae-454b-9ea5-c6838f914436 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:25.921836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9d942-bd8d-4441-ba8e-6e4d6800672b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:25.973240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f53239-80ea-4f38-af6e-4ac107fad236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:25.974515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f53239-80ea-4f38-af6e-4ac107fad236 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:25.975540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f53239-80ea-4f38-af6e-4ac107fad236 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:25.976406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f53239-80ea-4f38-af6e-4ac107fad236 None admin] PATH_INFO: `/v3/users/6fb46d8bb0394d54ba50f34ed8e76633` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:25.996817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f53239-80ea-4f38-af6e-4ac107fad236 None admin] RBAC: Authorizing `identity:get_user(user_id=6fb46d8bb0394d54ba50f34ed8e76633)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:25.998662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f53239-80ea-4f38-af6e-4ac107fad236 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:26.002405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 144/290] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:25 2022] GET /identity/v3/users/6fb46d8bb0394d54ba50f34ed8e76633 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:26.008453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f53239-80ea-4f38-af6e-4ac107fad236 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:26.028373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b046e-9fae-454b-9ea5-c6838f914436 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:26.049138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:26.067330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20527fe-c071-49cc-bb21-f5dcf46ee87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:26.067667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20527fe-c071-49cc-bb21-f5dcf46ee87b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:26.067850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20527fe-c071-49cc-bb21-f5dcf46ee87b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:26.068116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20527fe-c071-49cc-bb21-f5dcf46ee87b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:26.119220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:26.149796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20527fe-c071-49cc-bb21-f5dcf46ee87b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:26.151293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20527fe-c071-49cc-bb21-f5dcf46ee87b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:26.158016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f53239-80ea-4f38-af6e-4ac107fad236 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:26.215290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa2d29-cc2b-4937-840b-258c2a41bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:26.216363 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa2d29-cc2b-4937-840b-258c2a41bb79 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:26.216996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa2d29-cc2b-4937-840b-258c2a41bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:26.217368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa2d29-cc2b-4937-840b-258c2a41bb79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:26.218376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa2d29-cc2b-4937-840b-258c2a41bb79 None admin] RBAC: Adding query filter params (role.id=2d6cbe50524e4807bb6ab829cef3525c, user.id=6fb46d8bb0394d54ba50f34ed8e76633, scope.system=all) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:26.220649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa2d29-cc2b-4937-840b-258c2a41bb79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:26.222500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa2d29-cc2b-4937-840b-258c2a41bb79 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:26.230120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 145/291] 10.222.0.59 () {56 vars in 1308 bytes} [Wed Aug 24 11:32:26 2022] GET /identity/v3/role_assignments?user.id=6fb46d8bb0394d54ba50f34ed8e76633&scope.system=all&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:26.300852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 147/292] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:26.307131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa2d29-cc2b-4937-840b-258c2a41bb79 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:26.431664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:26.443796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa2d29-cc2b-4937-840b-258c2a41bb79 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:26.490817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ca25a-5d5f-4417-be8f-d5de17fadae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:26.491477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca25a-5d5f-4417-be8f-d5de17fadae2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:26.491754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca25a-5d5f-4417-be8f-d5de17fadae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:26.492025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca25a-5d5f-4417-be8f-d5de17fadae2 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:26.495571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ca25a-5d5f-4417-be8f-d5de17fadae2 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:26.497062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ca25a-5d5f-4417-be8f-d5de17fadae2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:26.499232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 146/293] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:26 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:26.505363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20527fe-c071-49cc-bb21-f5dcf46ee87b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:26.587861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:26.640030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20527fe-c071-49cc-bb21-f5dcf46ee87b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:26.685174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c71da9-988e-45b8-88d3-12f979792602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:26.685839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c71da9-988e-45b8-88d3-12f979792602 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:26.686125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c71da9-988e-45b8-88d3-12f979792602 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:26.686396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c71da9-988e-45b8-88d3-12f979792602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:26.687155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c71da9-988e-45b8-88d3-12f979792602 None admin] RBAC: Adding query filter params (role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=f06373c3edbc40b1880f456b42cc666a, user.id=106a4fb272244b4eb8522cbf1485faf6) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:26.687461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c71da9-988e-45b8-88d3-12f979792602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:26.689083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c71da9-988e-45b8-88d3-12f979792602 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:26.695451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 148/294] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:26 2022] GET /identity/v3/role_assignments?user.id=106a4fb272244b4eb8522cbf1485faf6&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:27.891638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e59be-b3b2-4e91-887e-851370b701a9 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:27.892861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e59be-b3b2-4e91-887e-851370b701a9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:27.892861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e59be-b3b2-4e91-887e-851370b701a9 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:27.894416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 147/295] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:27.899904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55f301-270d-41ed-acbf-5980b939beff None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:27.900357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55f301-270d-41ed-acbf-5980b939beff None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:27.900504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55f301-270d-41ed-acbf-5980b939beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:27.919932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ab55f301-270d-41ed-acbf-5980b939beff None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:27.921221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ab55f301-270d-41ed-acbf-5980b939beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:27.935833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f609-85df-4326-af79-69b9804bbb14 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:27.936122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f609-85df-4326-af79-69b9804bbb14 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:27.936390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f609-85df-4326-af79-69b9804bbb14 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:27.942426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 148/296] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:32:27.945100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af11a-93e3-434d-95b8-fb8b54d3b62a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:27.945442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af11a-93e3-434d-95b8-fb8b54d3b62a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:27.945667 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af11a-93e3-434d-95b8-fb8b54d3b62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:27.965971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f06af11a-93e3-434d-95b8-fb8b54d3b62a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:27.967227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f06af11a-93e3-434d-95b8-fb8b54d3b62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:28.006897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 149/297] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:28.048845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 149/298] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:28.170879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686ad3d-1947-436c-83e4-92662d753016 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:28.171482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686ad3d-1947-436c-83e4-92662d753016 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:28.171972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686ad3d-1947-436c-83e4-92662d753016 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:28.174527 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 150/299] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:28.179606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f4c15-4625-4ca5-b75b-f123e7845dc5 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:28.179896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f4c15-4625-4ca5-b75b-f123e7845dc5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:28.180196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f4c15-4625-4ca5-b75b-f123e7845dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:28.200619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-1b0f4c15-4625-4ca5-b75b-f123e7845dc5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:28.201823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1b0f4c15-4625-4ca5-b75b-f123e7845dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:28.271560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 150/300] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:28.297707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686ad3d-1947-436c-83e4-92662d753016 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:28.350229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f4c15-4625-4ca5-b75b-f123e7845dc5 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:28.373476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:28.377092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:28.430972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686ad3d-1947-436c-83e4-92662d753016 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:28.469353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f4c15-4625-4ca5-b75b-f123e7845dc5 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:28.471493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85b68e-7493-4605-ba47-12f4038beb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:28.472645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85b68e-7493-4605-ba47-12f4038beb89 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:28.472645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85b68e-7493-4605-ba47-12f4038beb89 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:28.472645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85b68e-7493-4605-ba47-12f4038beb89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:28.473778 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85b68e-7493-4605-ba47-12f4038beb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:28.475269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85b68e-7493-4605-ba47-12f4038beb89 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:28.480640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 151/301] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:28.480640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3bc1-426b-4ff1-8686-cc04442a8d1a None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:28.480640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3bc1-426b-4ff1-8686-cc04442a8d1a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:28.480640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3bc1-426b-4ff1-8686-cc04442a8d1a None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:28.481618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 152/302] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:28.483078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3bc1-426b-4ff1-8686-cc04442a8d1a None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:28.512582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273dfd4-ef37-445f-9f96-d1996d01482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:28.513371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273dfd4-ef37-445f-9f96-d1996d01482b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:28.513683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273dfd4-ef37-445f-9f96-d1996d01482b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:28.514067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273dfd4-ef37-445f-9f96-d1996d01482b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:28.526597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273dfd4-ef37-445f-9f96-d1996d01482b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-0273dfd4-ef37-445f-9f96-d1996d01482b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:28.531855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:28.532804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:28.533876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 151/303] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:28.534679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf26f2-7916-4661-b194-88b48bc49361 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:28.534961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf26f2-7916-4661-b194-88b48bc49361 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:28.535238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf26f2-7916-4661-b194-88b48bc49361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:28.562423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-9cdf26f2-7916-4661-b194-88b48bc49361 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:28.564255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9cdf26f2-7916-4661-b194-88b48bc49361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:28.596983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3bc1-426b-4ff1-8686-cc04442a8d1a None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:28.625586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:28.632102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a076f-117a-42ca-bfa1-bb6479858e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:28.632688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a076f-117a-42ca-bfa1-bb6479858e7e None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:28.632974 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a076f-117a-42ca-bfa1-bb6479858e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:28.633241 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a076f-117a-42ca-bfa1-bb6479858e7e None admin] PATH_INFO: `/v3/groups` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:28.633858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a076f-117a-42ca-bfa1-bb6479858e7e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:28.634599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 152/304] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:28.635481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf26f2-7916-4661-b194-88b48bc49361 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:28.635597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a076f-117a-42ca-bfa1-bb6479858e7e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:28.648706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:28.671206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 153/305] 10.222.0.59 () {60 vars in 1134 bytes} [Wed Aug 24 11:32:28 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:28.672575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a076f-117a-42ca-bfa1-bb6479858e7e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:28.779972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf26f2-7916-4661-b194-88b48bc49361 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:28.832013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a076f-117a-42ca-bfa1-bb6479858e7e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:28.833811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ae4f-8cc8-4e6c-8d7b-f6b3374991d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:28.834434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ae4f-8cc8-4e6c-8d7b-f6b3374991d2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:28.834716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ae4f-8cc8-4e6c-8d7b-f6b3374991d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:28.835034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ae4f-8cc8-4e6c-8d7b-f6b3374991d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:28.835708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ae4f-8cc8-4e6c-8d7b-f6b3374991d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:28.836014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ae4f-8cc8-4e6c-8d7b-f6b3374991d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:28.837391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ae4f-8cc8-4e6c-8d7b-f6b3374991d2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:28.848297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 153/306] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:28.855314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ae4f-8cc8-4e6c-8d7b-f6b3374991d2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:28.884261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e117e-ff6e-452f-a451-f9f5292f822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:28.885983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e117e-ff6e-452f-a451-f9f5292f822e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:28.886607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e117e-ff6e-452f-a451-f9f5292f822e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:28.887186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e117e-ff6e-452f-a451-f9f5292f822e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:28.901546 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e117e-ff6e-452f-a451-f9f5292f822e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-c10e117e-ff6e-452f-a451-f9f5292f822e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:28.909582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:28.910547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:28.911379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:28.912913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 154/307] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:28.915287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e117e-ff6e-452f-a451-f9f5292f822e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:28.948290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:28.978071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:28.982437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ae4f-8cc8-4e6c-8d7b-f6b3374991d2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.020531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483f72-0319-4896-b247-b26d3cdda145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.021291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483f72-0319-4896-b247-b26d3cdda145 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.021636 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483f72-0319-4896-b247-b26d3cdda145 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.022160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483f72-0319-4896-b247-b26d3cdda145 None admin] PATH_INFO: `/v3/users/6476832729b642bea96df74ed3a37057` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.036567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c483f72-0319-4896-b247-b26d3cdda145 None admin] RBAC: Authorizing `identity:get_user(user_id=6476832729b642bea96df74ed3a37057)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:29.036720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e117e-ff6e-452f-a451-f9f5292f822e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.037989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c483f72-0319-4896-b247-b26d3cdda145 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:29.039857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 154/308] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:28 2022] GET /identity/v3/users/6476832729b642bea96df74ed3a37057 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:29.040432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483f72-0319-4896-b247-b26d3cdda145 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:29.072797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29491dc6-68d2-473f-bd54-4e7d5866c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.073540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29491dc6-68d2-473f-bd54-4e7d5866c80a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.073721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29491dc6-68d2-473f-bd54-4e7d5866c80a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.073988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29491dc6-68d2-473f-bd54-4e7d5866c80a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.086421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29491dc6-68d2-473f-bd54-4e7d5866c80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-29491dc6-68d2-473f-bd54-4e7d5866c80a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:29.091900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:29.092972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:29.093800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 155/309] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:29.094438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29491dc6-68d2-473f-bd54-4e7d5866c80a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:29.163109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483f72-0319-4896-b247-b26d3cdda145 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.199630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:29.206799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29491dc6-68d2-473f-bd54-4e7d5866c80a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.207446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9de5b2-5296-4281-a87c-9b9209a6c62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.208057 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9de5b2-5296-4281-a87c-9b9209a6c62a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.208449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9de5b2-5296-4281-a87c-9b9209a6c62a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.208721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9de5b2-5296-4281-a87c-9b9209a6c62a None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.209742 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9de5b2-5296-4281-a87c-9b9209a6c62a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:29.209848 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9de5b2-5296-4281-a87c-9b9209a6c62a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:29.211239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9de5b2-5296-4281-a87c-9b9209a6c62a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:29.217709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:29.222439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 155/310] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:29.227526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9de5b2-5296-4281-a87c-9b9209a6c62a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:29.244113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47dc12-724c-488b-8494-970b7eeac86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.244721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47dc12-724c-488b-8494-970b7eeac86e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.244994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47dc12-724c-488b-8494-970b7eeac86e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.245266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47dc12-724c-488b-8494-970b7eeac86e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.245992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47dc12-724c-488b-8494-970b7eeac86e None admin] RBAC: Adding query filter params (role.id=fcc7d8db3d7249f393782c75305077c2, user.id=6476832729b642bea96df74ed3a37057, scope.system=all) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:29.246299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47dc12-724c-488b-8494-970b7eeac86e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:29.247776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47dc12-724c-488b-8494-970b7eeac86e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:29.262798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 156/311] 10.222.0.59 () {56 vars in 1308 bytes} [Wed Aug 24 11:32:29 2022] GET /identity/v3/role_assignments?user.id=6476832729b642bea96df74ed3a37057&scope.system=all&role.id=fcc7d8db3d7249f393782c75305077c2 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:29.262798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47dc12-724c-488b-8494-970b7eeac86e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:29.375013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47dc12-724c-488b-8494-970b7eeac86e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.376659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9de5b2-5296-4281-a87c-9b9209a6c62a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.423912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c2d4-a8cd-4d60-84e8-9f68c2fde92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.424559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c2d4-a8cd-4d60-84e8-9f68c2fde92f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.424839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c2d4-a8cd-4d60-84e8-9f68c2fde92f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.425111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c2d4-a8cd-4d60-84e8-9f68c2fde92f None admin] PATH_INFO: `/v3/users/5eba8ccba25c424ba45279a379f9fc6c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.426239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51c2d4-a8cd-4d60-84e8-9f68c2fde92f None admin] RBAC: Authorizing `identity:get_user(user_id=5eba8ccba25c424ba45279a379f9fc6c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:29.428241 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51c2d4-a8cd-4d60-84e8-9f68c2fde92f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:29.429070 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37966e9e-df81-4265-81f0-c24d3a8de31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.434723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 157/312] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:29 2022] GET /identity/v3/users/5eba8ccba25c424ba45279a379f9fc6c => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:29.434872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37966e9e-df81-4265-81f0-c24d3a8de31f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.434872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37966e9e-df81-4265-81f0-c24d3a8de31f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.434872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37966e9e-df81-4265-81f0-c24d3a8de31f None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.434872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37966e9e-df81-4265-81f0-c24d3a8de31f None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:29.434872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37966e9e-df81-4265-81f0-c24d3a8de31f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:29.434872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37966e9e-df81-4265-81f0-c24d3a8de31f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:29.435240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c2d4-a8cd-4d60-84e8-9f68c2fde92f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:29.445997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 156/313] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:29.453003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37966e9e-df81-4265-81f0-c24d3a8de31f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:29.485386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:29.527067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:29.556642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c2d4-a8cd-4d60-84e8-9f68c2fde92f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.583551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37966e9e-df81-4265-81f0-c24d3a8de31f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.601382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070941-1e7f-4c38-95ea-984a6d5e4a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.601952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070941-1e7f-4c38-95ea-984a6d5e4a24 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.602228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070941-1e7f-4c38-95ea-984a6d5e4a24 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.602496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070941-1e7f-4c38-95ea-984a6d5e4a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.624814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40addf-955e-4810-9df3-75b20d15fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.625847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40addf-955e-4810-9df3-75b20d15fed6 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.626112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40addf-955e-4810-9df3-75b20d15fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.626969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40addf-955e-4810-9df3-75b20d15fed6 None admin] PATH_INFO: `/v3/users/6fb46d8bb0394d54ba50f34ed8e76633` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.628594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40addf-955e-4810-9df3-75b20d15fed6 None admin] RBAC: Authorizing `identity:get_user(user_id=6fb46d8bb0394d54ba50f34ed8e76633)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:29.630341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40addf-955e-4810-9df3-75b20d15fed6 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:29.636960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 157/314] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:29 2022] GET /identity/v3/users/6fb46d8bb0394d54ba50f34ed8e76633 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:29.638741 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40addf-955e-4810-9df3-75b20d15fed6 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:29.686340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94070941-1e7f-4c38-95ea-984a6d5e4a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:29.687969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94070941-1e7f-4c38-95ea-984a6d5e4a24 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:29.733991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:29.755849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40addf-955e-4810-9df3-75b20d15fed6 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.784503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:29.801499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 158/315] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:29.806983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070941-1e7f-4c38-95ea-984a6d5e4a24 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:29.810751 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c953f4b-83d2-4d5c-bc36-3232d9785ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.811573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953f4b-83d2-4d5c-bc36-3232d9785ed1 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.811919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953f4b-83d2-4d5c-bc36-3232d9785ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.812282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953f4b-83d2-4d5c-bc36-3232d9785ed1 None admin] PATH_INFO: `/v3/system/users/6fb46d8bb0394d54ba50f34ed8e76633/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.813872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c953f4b-83d2-4d5c-bc36-3232d9785ed1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6fb46d8bb0394d54ba50f34ed8e76633, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:29.815792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c953f4b-83d2-4d5c-bc36-3232d9785ed1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:29.830817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 158/316] 10.222.0.59 () {58 vars in 1334 bytes} [Wed Aug 24 11:32:29 2022] PUT /identity/v3/system/users/6fb46d8bb0394d54ba50f34ed8e76633/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:29.940394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070941-1e7f-4c38-95ea-984a6d5e4a24 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:29.980631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98841b-fffd-469d-8ee4-2a0e81a024cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:29.981268 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98841b-fffd-469d-8ee4-2a0e81a024cf None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:29.981542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98841b-fffd-469d-8ee4-2a0e81a024cf None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:29.981835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98841b-fffd-469d-8ee4-2a0e81a024cf None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:29.982973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98841b-fffd-469d-8ee4-2a0e81a024cf None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:29.984464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98841b-fffd-469d-8ee4-2a0e81a024cf None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:29.986853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 159/317] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:29 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:29.992579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c953f4b-83d2-4d5c-bc36-3232d9785ed1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:30.109676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c953f4b-83d2-4d5c-bc36-3232d9785ed1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:30.145882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e9eea-e5dd-4dcd-bd9c-05a15d59f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:30.146497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9eea-e5dd-4dcd-bd9c-05a15d59f8f1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:30.146877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9eea-e5dd-4dcd-bd9c-05a15d59f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:30.147155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9eea-e5dd-4dcd-bd9c-05a15d59f8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:30.147890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e9eea-e5dd-4dcd-bd9c-05a15d59f8f1 None admin] RBAC: Adding query filter params (role.id=fcc7d8db3d7249f393782c75305077c2, scope.project.id=f06373c3edbc40b1880f456b42cc666a, user.id=5eba8ccba25c424ba45279a379f9fc6c) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:30.148202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e9eea-e5dd-4dcd-bd9c-05a15d59f8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:30.149638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e9eea-e5dd-4dcd-bd9c-05a15d59f8f1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:30.156278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 159/318] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:29 2022] GET /identity/v3/role_assignments?user.id=5eba8ccba25c424ba45279a379f9fc6c&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=fcc7d8db3d7249f393782c75305077c2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:30.747962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b27c5c-f1a2-4b5c-9ca6-b93cc9e49b36 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:30.748355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b27c5c-f1a2-4b5c-9ca6-b93cc9e49b36 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:30.748581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b27c5c-f1a2-4b5c-9ca6-b93cc9e49b36 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:30.749951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 160/319] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:30.755226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3c6c3-f6c4-4bda-aeb5-1fa35f96e8b2 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:30.755517 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3c6c3-f6c4-4bda-aeb5-1fa35f96e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:30.755789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3c6c3-f6c4-4bda-aeb5-1fa35f96e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:30.774174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4fc3c6c3-f6c4-4bda-aeb5-1fa35f96e8b2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:30.775387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4fc3c6c3-f6c4-4bda-aeb5-1fa35f96e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:30.824485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:30.850953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 160/320] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:31.114214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b27c5c-f1a2-4b5c-9ca6-b93cc9e49b36 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:31.129842 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:31.225649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b27c5c-f1a2-4b5c-9ca6-b93cc9e49b36 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:31.261755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de920b15-f5e5-4d01-9295-aa45f8fd9f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:31.262385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de920b15-f5e5-4d01-9295-aa45f8fd9f2e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:31.262657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de920b15-f5e5-4d01-9295-aa45f8fd9f2e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:31.262950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de920b15-f5e5-4d01-9295-aa45f8fd9f2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:31.264063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de920b15-f5e5-4d01-9295-aa45f8fd9f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:31.265487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de920b15-f5e5-4d01-9295-aa45f8fd9f2e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:31.268068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 161/321] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:31.273399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3c6c3-f6c4-4bda-aeb5-1fa35f96e8b2 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:31.320450 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604307a9-01d8-4a34-b88a-c219b67696de None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:31.320741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604307a9-01d8-4a34-b88a-c219b67696de None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:31.321017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604307a9-01d8-4a34-b88a-c219b67696de None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:31.322499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 162/322] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:32:31.327367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac120972-aa51-45a4-87de-2a68c9826c18 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:31.327657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac120972-aa51-45a4-87de-2a68c9826c18 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:31.327936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac120972-aa51-45a4-87de-2a68c9826c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:31.348362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ac120972-aa51-45a4-87de-2a68c9826c18 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:31.349585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ac120972-aa51-45a4-87de-2a68c9826c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:31.377470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3c6c3-f6c4-4bda-aeb5-1fa35f96e8b2 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:31.421120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a3157-8810-4321-a91b-7a9f45672f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:31.421729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3157-8810-4321-a91b-7a9f45672f53 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:31.422008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3157-8810-4321-a91b-7a9f45672f53 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:31.422316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3157-8810-4321-a91b-7a9f45672f53 None admin] PATH_INFO: `/v3/groups` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:31.422998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3157-8810-4321-a91b-7a9f45672f53 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:31.424445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3157-8810-4321-a91b-7a9f45672f53 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:31.428539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 163/323] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:31.445017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 161/324] 10.222.0.59 () {60 vars in 1134 bytes} [Wed Aug 24 11:32:31 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:31.711100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac120972-aa51-45a4-87de-2a68c9826c18 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:31.723389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:31.819947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190be2-2168-426b-b378-a652f29543ce None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:31.820589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190be2-2168-426b-b378-a652f29543ce None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:31.821091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190be2-2168-426b-b378-a652f29543ce None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:31.823687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 162/325] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:31.825143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac120972-aa51-45a4-87de-2a68c9826c18 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:31.834277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f961296-2dc9-4996-b27c-e3fd56cff1ba None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:31.834885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f961296-2dc9-4996-b27c-e3fd56cff1ba None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:31.835367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f961296-2dc9-4996-b27c-e3fd56cff1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:31.863056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5f961296-2dc9-4996-b27c-e3fd56cff1ba None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:31.865190 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5f961296-2dc9-4996-b27c-e3fd56cff1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:31.874433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f469cc-48e9-4878-91e2-2f35d0edae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:31.875117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f469cc-48e9-4878-91e2-2f35d0edae10 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:31.875400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f469cc-48e9-4878-91e2-2f35d0edae10 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:31.875673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f469cc-48e9-4878-91e2-2f35d0edae10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:31.890901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f469cc-48e9-4878-91e2-2f35d0edae10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-88f469cc-48e9-4878-91e2-2f35d0edae10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:31.896099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:31.897019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:31.897823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 164/326] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:31.904842 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f469cc-48e9-4878-91e2-2f35d0edae10 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:31.915475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:31.983051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 163/327] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:32.019334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:32.054263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f469cc-48e9-4878-91e2-2f35d0edae10 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:32.090803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceff8c-6bc9-4ae5-af6b-20c4c6649e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:32.091422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceff8c-6bc9-4ae5-af6b-20c4c6649e8e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:32.091701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceff8c-6bc9-4ae5-af6b-20c4c6649e8e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:32.091976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceff8c-6bc9-4ae5-af6b-20c4c6649e8e None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:32.092641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceff8c-6bc9-4ae5-af6b-20c4c6649e8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:32.092945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceff8c-6bc9-4ae5-af6b-20c4c6649e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:32.094405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceff8c-6bc9-4ae5-af6b-20c4c6649e8e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:32.103940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 165/328] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:32.109318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f961296-2dc9-4996-b27c-e3fd56cff1ba None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:32.240480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f961296-2dc9-4996-b27c-e3fd56cff1ba None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:32.293050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78185080-ee28-4f8e-8bb8-0ffbfe105735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:32.294458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78185080-ee28-4f8e-8bb8-0ffbfe105735 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:32.295020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78185080-ee28-4f8e-8bb8-0ffbfe105735 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:32.295512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78185080-ee28-4f8e-8bb8-0ffbfe105735 None admin] PATH_INFO: `/v3/users/6476832729b642bea96df74ed3a37057` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:32.296880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78185080-ee28-4f8e-8bb8-0ffbfe105735 None admin] RBAC: Authorizing `identity:get_user(user_id=6476832729b642bea96df74ed3a37057)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:32.299164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78185080-ee28-4f8e-8bb8-0ffbfe105735 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:32.306819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceff8c-6bc9-4ae5-af6b-20c4c6649e8e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:32.307790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 164/329] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:32 2022] GET /identity/v3/users/6476832729b642bea96df74ed3a37057 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:32.308974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78185080-ee28-4f8e-8bb8-0ffbfe105735 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:32.357574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:32.447919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78185080-ee28-4f8e-8bb8-0ffbfe105735 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:32.448555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceff8c-6bc9-4ae5-af6b-20c4c6649e8e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:32.489094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6953c9c-2416-4df8-8dd0-e069ae070848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:32.489739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953c9c-2416-4df8-8dd0-e069ae070848 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:32.490018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953c9c-2416-4df8-8dd0-e069ae070848 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:32.490292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953c9c-2416-4df8-8dd0-e069ae070848 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:32.502850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6953c9c-2416-4df8-8dd0-e069ae070848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-b6953c9c-2416-4df8-8dd0-e069ae070848 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:32.508547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:32.509714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:32.510493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 165/330] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:32.519516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6953c9c-2416-4df8-8dd0-e069ae070848 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:32.522041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:32.552477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c14827-2beb-4214-be10-e5b1cb36b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:32.553209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c14827-2beb-4214-be10-e5b1cb36b1ed None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:32.553438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c14827-2beb-4214-be10-e5b1cb36b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:32.553715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c14827-2beb-4214-be10-e5b1cb36b1ed None admin] PATH_INFO: `/v3/system/users/6476832729b642bea96df74ed3a37057/roles/fcc7d8db3d7249f393782c75305077c2` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:32.555202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c14827-2beb-4214-be10-e5b1cb36b1ed None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6476832729b642bea96df74ed3a37057, role_id=fcc7d8db3d7249f393782c75305077c2)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:32.556602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c14827-2beb-4214-be10-e5b1cb36b1ed None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:32.571636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 166/331] 10.222.0.59 () {58 vars in 1334 bytes} [Wed Aug 24 11:32:32 2022] PUT /identity/v3/system/users/6476832729b642bea96df74ed3a37057/roles/fcc7d8db3d7249f393782c75305077c2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:32:32.643151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:32.648221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6953c9c-2416-4df8-8dd0-e069ae070848 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:32.689391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757996a7-08b3-4e87-9744-5d473a25b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:32.690505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757996a7-08b3-4e87-9744-5d473a25b30e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:32.691062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757996a7-08b3-4e87-9744-5d473a25b30e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:32.691562 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757996a7-08b3-4e87-9744-5d473a25b30e None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:32.692692 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757996a7-08b3-4e87-9744-5d473a25b30e None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:32.693174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757996a7-08b3-4e87-9744-5d473a25b30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:32.694843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757996a7-08b3-4e87-9744-5d473a25b30e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:32.706091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 166/332] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:32.711582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c14827-2beb-4214-be10-e5b1cb36b1ed None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:32.840050 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c14827-2beb-4214-be10-e5b1cb36b1ed None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:32.887162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867cce2-ce20-4f74-92a9-0a19595461a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:32.887801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cce2-ce20-4f74-92a9-0a19595461a6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:32.888076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cce2-ce20-4f74-92a9-0a19595461a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:32.888350 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cce2-ce20-4f74-92a9-0a19595461a6 None admin] PATH_INFO: `/v3/users/6fb46d8bb0394d54ba50f34ed8e76633` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:32.889550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867cce2-ce20-4f74-92a9-0a19595461a6 None admin] RBAC: Authorizing `identity:get_user(user_id=6fb46d8bb0394d54ba50f34ed8e76633)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:32.891021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867cce2-ce20-4f74-92a9-0a19595461a6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:32.893190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 167/333] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:32 2022] GET /identity/v3/users/6fb46d8bb0394d54ba50f34ed8e76633 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:32.901083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757996a7-08b3-4e87-9744-5d473a25b30e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:33.036794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757996a7-08b3-4e87-9744-5d473a25b30e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:33.073321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3d6aa-59db-4675-9925-1c315c0255bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:33.073998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3d6aa-59db-4675-9925-1c315c0255bf None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:33.074313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3d6aa-59db-4675-9925-1c315c0255bf None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:33.074641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3d6aa-59db-4675-9925-1c315c0255bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:33.075406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3d6aa-59db-4675-9925-1c315c0255bf None admin] RBAC: Adding query filter params (role.id=2d6cbe50524e4807bb6ab829cef3525c, user.id=6fb46d8bb0394d54ba50f34ed8e76633, scope.system=all) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:33.075714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3d6aa-59db-4675-9925-1c315c0255bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:33.077142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3d6aa-59db-4675-9925-1c315c0255bf None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:33.092775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 167/334] 10.222.0.59 () {56 vars in 1308 bytes} [Wed Aug 24 11:32:32 2022] GET /identity/v3/role_assignments?user.id=6fb46d8bb0394d54ba50f34ed8e76633&scope.system=all&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:34.273877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be3b6-08c3-4d99-9aa1-64e45f776ca2 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:34.274825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be3b6-08c3-4d99-9aa1-64e45f776ca2 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:34.275305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be3b6-08c3-4d99-9aa1-64e45f776ca2 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:34.277135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 168/335] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:34.283031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48445f-c741-4de3-bbaf-9e510adad02b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:34.283607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48445f-c741-4de3-bbaf-9e510adad02b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:34.283607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48445f-c741-4de3-bbaf-9e510adad02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:34.308046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4a48445f-c741-4de3-bbaf-9e510adad02b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:34.309266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4a48445f-c741-4de3-bbaf-9e510adad02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:34.328784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:34.405051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 168/336] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:34.652086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495772a-57b6-426e-8c67-7a2ff106c1e5 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:34.652719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495772a-57b6-426e-8c67-7a2ff106c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:34.653198 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495772a-57b6-426e-8c67-7a2ff106c1e5 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:34.654742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 169/337] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:34.661789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad16d-63cd-45a6-b4f1-f60fcffd52be None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:34.662083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad16d-63cd-45a6-b4f1-f60fcffd52be None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:34.662336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad16d-63cd-45a6-b4f1-f60fcffd52be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:34.686840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-a77ad16d-63cd-45a6-b4f1-f60fcffd52be None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:34.688095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a77ad16d-63cd-45a6-b4f1-f60fcffd52be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:34.785025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 169/338] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:34.849762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495772a-57b6-426e-8c67-7a2ff106c1e5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:34.942335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:34.988433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495772a-57b6-426e-8c67-7a2ff106c1e5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:35.030930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d1ef-40aa-4770-be48-98994a39ab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:35.031570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d1ef-40aa-4770-be48-98994a39ab61 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.031850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d1ef-40aa-4770-be48-98994a39ab61 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.032125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d1ef-40aa-4770-be48-98994a39ab61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.045065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3d1ef-40aa-4770-be48-98994a39ab61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-c1f3d1ef-40aa-4770-be48-98994a39ab61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:35.050809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:35.051684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:35.052465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 170/339] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:35.058305 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad16d-63cd-45a6-b4f1-f60fcffd52be None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:35.089366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f356-dd74-4eb5-a85b-be2d11ab62e9 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.089668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f356-dd74-4eb5-a85b-be2d11ab62e9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.089921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f356-dd74-4eb5-a85b-be2d11ab62e9 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.091590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 171/340] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:35.097567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1e419-f654-456d-b561-160d88a9a879 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.097847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1e419-f654-456d-b561-160d88a9a879 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.098119 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1e419-f654-456d-b561-160d88a9a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.129881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c0e1e419-f654-456d-b561-160d88a9a879 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:35.129881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c0e1e419-f654-456d-b561-160d88a9a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:35.198694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:35.233165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 172/341] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:35.234570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad16d-63cd-45a6-b4f1-f60fcffd52be None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:35.255498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1e419-f654-456d-b561-160d88a9a879 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:35.292891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df3e4-657b-4e10-b3dc-4aaa162e0bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:35.294297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df3e4-657b-4e10-b3dc-4aaa162e0bd2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.294886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df3e4-657b-4e10-b3dc-4aaa162e0bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.295350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df3e4-657b-4e10-b3dc-4aaa162e0bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.296211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df3e4-657b-4e10-b3dc-4aaa162e0bd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:35.296780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df3e4-657b-4e10-b3dc-4aaa162e0bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:35.299154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df3e4-657b-4e10-b3dc-4aaa162e0bd2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:35.316557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 170/342] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:35.323210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:35.336975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df3e4-657b-4e10-b3dc-4aaa162e0bd2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:35.395068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1e419-f654-456d-b561-160d88a9a879 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:35.454612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe8f98-c685-42e0-ac06-6a48cd75fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:35.455252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8f98-c685-42e0-ac06-6a48cd75fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.455535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8f98-c685-42e0-ac06-6a48cd75fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.455804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8f98-c685-42e0-ac06-6a48cd75fdc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.472947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe8f98-c685-42e0-ac06-6a48cd75fdc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-fbbe8f98-c685-42e0-ac06-6a48cd75fdc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:35.477811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:35.478735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:35.479576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:35.482961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df3e4-657b-4e10-b3dc-4aaa162e0bd2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:35.483193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 173/343] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:35.484788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601151-db5c-4e12-8b83-1b19d5b10ec9 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.485071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601151-db5c-4e12-8b83-1b19d5b10ec9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.485374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601151-db5c-4e12-8b83-1b19d5b10ec9 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.487732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 174/344] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:35.512141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c4fb7-4948-47fa-bcc3-4a81bfe688cd None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.512437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c4fb7-4948-47fa-bcc3-4a81bfe688cd None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.512683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c4fb7-4948-47fa-bcc3-4a81bfe688cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.533591 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a3f8-dd7c-4e03-8ae8-027aaf0acb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:35.534321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a3f8-dd7c-4e03-8ae8-027aaf0acb65 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.534602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a3f8-dd7c-4e03-8ae8-027aaf0acb65 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.534914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a3f8-dd7c-4e03-8ae8-027aaf0acb65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.546557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:35.550820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-860c4fb7-4948-47fa-bcc3-4a81bfe688cd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:35.552058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-860c4fb7-4948-47fa-bcc3-4a81bfe688cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:35.612017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a3f8-dd7c-4e03-8ae8-027aaf0acb65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:35.613555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a3f8-dd7c-4e03-8ae8-027aaf0acb65 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:35.644862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 175/345] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:35.645550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c4fb7-4948-47fa-bcc3-4a81bfe688cd None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:35.694850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:35.764706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c4fb7-4948-47fa-bcc3-4a81bfe688cd None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:35.772766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 171/346] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:35.773695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a3f8-dd7c-4e03-8ae8-027aaf0acb65 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:35.804322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05862f-fbf7-492c-a4d2-673fce1417ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:35.805364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05862f-fbf7-492c-a4d2-673fce1417ad None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.805650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05862f-fbf7-492c-a4d2-673fce1417ad None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.805927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05862f-fbf7-492c-a4d2-673fce1417ad None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.806605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05862f-fbf7-492c-a4d2-673fce1417ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:35.807082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05862f-fbf7-492c-a4d2-673fce1417ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:35.809641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05862f-fbf7-492c-a4d2-673fce1417ad None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:35.821087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 176/347] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:35.821994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05862f-fbf7-492c-a4d2-673fce1417ad None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:35.843073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:35.911708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a3f8-dd7c-4e03-8ae8-027aaf0acb65 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:35.959346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a717052-5497-4c2c-beae-e4bf0f8c5885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:35.960139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717052-5497-4c2c-beae-e4bf0f8c5885 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:35.960508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717052-5497-4c2c-beae-e4bf0f8c5885 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:35.960787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717052-5497-4c2c-beae-e4bf0f8c5885 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:35.963080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05862f-fbf7-492c-a4d2-673fce1417ad None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:35.965541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:35.974527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a717052-5497-4c2c-beae-e4bf0f8c5885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-3a717052-5497-4c2c-beae-e4bf0f8c5885 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:35.980354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:35.981327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:35.982124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 172/348] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:35.982805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a717052-5497-4c2c-beae-e4bf0f8c5885 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:36.019643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7ffe3-b09e-4cdd-9d17-28da50a72fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:36.020193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7ffe3-b09e-4cdd-9d17-28da50a72fc1 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:36.020476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7ffe3-b09e-4cdd-9d17-28da50a72fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:36.020750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7ffe3-b09e-4cdd-9d17-28da50a72fc1 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:36.021883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7ffe3-b09e-4cdd-9d17-28da50a72fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:36.023412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7ffe3-b09e-4cdd-9d17-28da50a72fc1 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:36.025217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 177/349] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:35 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:36.030851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7100-334a-49ac-9b50-c48adba1ac33 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:36.030851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7100-334a-49ac-9b50-c48adba1ac33 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:36.030851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7100-334a-49ac-9b50-c48adba1ac33 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:36.034600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 178/350] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:36.034849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff7100-334a-49ac-9b50-c48adba1ac33 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:36.115961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:36.119666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a717052-5497-4c2c-beae-e4bf0f8c5885 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:36.164130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b35418-9b7a-4859-8cd8-17d54d8ad9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:36.164756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b35418-9b7a-4859-8cd8-17d54d8ad9f3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:36.165038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b35418-9b7a-4859-8cd8-17d54d8ad9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:36.165313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b35418-9b7a-4859-8cd8-17d54d8ad9f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:36.169752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff7100-334a-49ac-9b50-c48adba1ac33 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:36.219510 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88e8ce-f09d-47cd-8734-30b31a95dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:36.220678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88e8ce-f09d-47cd-8734-30b31a95dd67 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:36.220960 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88e8ce-f09d-47cd-8734-30b31a95dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:36.224232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88e8ce-f09d-47cd-8734-30b31a95dd67 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:36.224232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88e8ce-f09d-47cd-8734-30b31a95dd67 None admin] RBAC: Adding query filter params (name=member) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:36.224232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88e8ce-f09d-47cd-8734-30b31a95dd67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:36.224232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88e8ce-f09d-47cd-8734-30b31a95dd67 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:36.235311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 179/351] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:36.237079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88e8ce-f09d-47cd-8734-30b31a95dd67 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:36.254857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b35418-9b7a-4859-8cd8-17d54d8ad9f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:36.256665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b35418-9b7a-4859-8cd8-17d54d8ad9f3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:36.285833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:36.387059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88e8ce-f09d-47cd-8734-30b31a95dd67 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:36.404195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:36.408444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 173/352] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:36.412206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780d7f7-38c8-4e62-96ef-d25285f8c39e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:36.412487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780d7f7-38c8-4e62-96ef-d25285f8c39e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:36.412764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780d7f7-38c8-4e62-96ef-d25285f8c39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:36.432541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f780d7f7-38c8-4e62-96ef-d25285f8c39e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:36.433858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f780d7f7-38c8-4e62-96ef-d25285f8c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:36.436381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b113b-2e34-401c-b77c-59368739324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:36.438133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b113b-2e34-401c-b77c-59368739324f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:36.439284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b113b-2e34-401c-b77c-59368739324f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:36.439775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b113b-2e34-401c-b77c-59368739324f None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:36.447570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b113b-2e34-401c-b77c-59368739324f None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:36.449568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b113b-2e34-401c-b77c-59368739324f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:36.451439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 180/353] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:36 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:36.452385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b113b-2e34-401c-b77c-59368739324f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:36.524193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 174/354] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:36.524957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780d7f7-38c8-4e62-96ef-d25285f8c39e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:36.581952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:36.586550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b113b-2e34-401c-b77c-59368739324f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:36.631285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4534ef-9170-442d-bf00-c579fb69bbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:36.632279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4534ef-9170-442d-bf00-c579fb69bbd2 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:36.632769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4534ef-9170-442d-bf00-c579fb69bbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:36.633011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780d7f7-38c8-4e62-96ef-d25285f8c39e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:36.633430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4534ef-9170-442d-bf00-c579fb69bbd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:36.645754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4534ef-9170-442d-bf00-c579fb69bbd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-2e4534ef-9170-442d-bf00-c579fb69bbd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:36.651788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:36.652805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 11:32:36.653605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:36.656020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 181/355] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:36.657084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4534ef-9170-442d-bf00-c579fb69bbd2 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:36.670345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:36.677963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e096e3-1d62-4f82-ad28-4a6042dd308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:36.679117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e096e3-1d62-4f82-ad28-4a6042dd308b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:36.679522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e096e3-1d62-4f82-ad28-4a6042dd308b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:36.679857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e096e3-1d62-4f82-ad28-4a6042dd308b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:36.767783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e096e3-1d62-4f82-ad28-4a6042dd308b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:36.769281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e096e3-1d62-4f82-ad28-4a6042dd308b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:36.788116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4534ef-9170-442d-bf00-c579fb69bbd2 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:36.835053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3636795-b421-438e-81bd-0aa23e07a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:36.835615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3636795-b421-438e-81bd-0aa23e07a464 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:36.835894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3636795-b421-438e-81bd-0aa23e07a464 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:36.836162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3636795-b421-438e-81bd-0aa23e07a464 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:36.837300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3636795-b421-438e-81bd-0aa23e07a464 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:36.838739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3636795-b421-438e-81bd-0aa23e07a464 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:36.840397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 182/356] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:36 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:36.841240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3636795-b421-438e-81bd-0aa23e07a464 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:36.881785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:36.900446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 175/357] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:36.901828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e096e3-1d62-4f82-ad28-4a6042dd308b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:36.935252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:36.976370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3636795-b421-438e-81bd-0aa23e07a464 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.016475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ebf36-3138-49f7-a6db-2a9b3821d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:37.017423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ebf36-3138-49f7-a6db-2a9b3821d8ba None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.017702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ebf36-3138-49f7-a6db-2a9b3821d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.017994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ebf36-3138-49f7-a6db-2a9b3821d8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.018718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ebf36-3138-49f7-a6db-2a9b3821d8ba None admin] RBAC: Adding query filter params (group.id=71a4ed5e1b0647e99575dacf405dac1c, role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=b0de385b20724662bfc182dd6a4c2641) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:37.019149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ebf36-3138-49f7-a6db-2a9b3821d8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:37.020595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ebf36-3138-49f7-a6db-2a9b3821d8ba None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:37.023478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e096e3-1d62-4f82-ad28-4a6042dd308b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.027004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 183/358] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:36 2022] GET /identity/v3/role_assignments?group.id=71a4ed5e1b0647e99575dacf405dac1c&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:37.028052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ced4e-6816-4f6c-9a83-147798943455 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.028338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ced4e-6816-4f6c-9a83-147798943455 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.028617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ced4e-6816-4f6c-9a83-147798943455 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.030155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 184/359] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:37.030956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ced4e-6816-4f6c-9a83-147798943455 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:37.073054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37720d-c0a3-4222-a426-3f7e6f680d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:37.074002 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37720d-c0a3-4222-a426-3f7e6f680d18 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.074489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37720d-c0a3-4222-a426-3f7e6f680d18 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.074999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37720d-c0a3-4222-a426-3f7e6f680d18 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.075827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37720d-c0a3-4222-a426-3f7e6f680d18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:37.076279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37720d-c0a3-4222-a426-3f7e6f680d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:37.077847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37720d-c0a3-4222-a426-3f7e6f680d18 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:37.089662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 176/360] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:37.090453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37720d-c0a3-4222-a426-3f7e6f680d18 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:37.165027 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:37.181835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ced4e-6816-4f6c-9a83-147798943455 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.222957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:37.237710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7320e-449e-40da-a2b3-43c607c07ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:37.238353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7320e-449e-40da-a2b3-43c607c07ffa None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.238629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7320e-449e-40da-a2b3-43c607c07ffa None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.238940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7320e-449e-40da-a2b3-43c607c07ffa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.239265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37720d-c0a3-4222-a426-3f7e6f680d18 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.254718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7320e-449e-40da-a2b3-43c607c07ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-e7d7320e-449e-40da-a2b3-43c607c07ffa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:37.260112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:37.261138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:37.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:37.264129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 185/361] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:37.265157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7320e-449e-40da-a2b3-43c607c07ffa None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:37.286622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407f654-768b-4b93-a2bf-410a2af22f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:37.287312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407f654-768b-4b93-a2bf-410a2af22f8d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.287598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407f654-768b-4b93-a2bf-410a2af22f8d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.287927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407f654-768b-4b93-a2bf-410a2af22f8d None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.289248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407f654-768b-4b93-a2bf-410a2af22f8d None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:37.290784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407f654-768b-4b93-a2bf-410a2af22f8d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:37.292419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 177/362] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:37 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:37.293550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e06a-e346-4dc2-93d7-d51e47a875b1 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.293832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e06a-e346-4dc2-93d7-d51e47a875b1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.294105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e06a-e346-4dc2-93d7-d51e47a875b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.313515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e0a5e06a-e346-4dc2-93d7-d51e47a875b1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:37.315022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e0a5e06a-e346-4dc2-93d7-d51e47a875b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:37.407415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7320e-449e-40da-a2b3-43c607c07ffa None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.414720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 178/363] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:37.415493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e06a-e346-4dc2-93d7-d51e47a875b1 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:37.447728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833eb72-289f-4c13-8bc6-985035f11ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:37.448783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833eb72-289f-4c13-8bc6-985035f11ab9 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.449266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833eb72-289f-4c13-8bc6-985035f11ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.449864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833eb72-289f-4c13-8bc6-985035f11ab9 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.451375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833eb72-289f-4c13-8bc6-985035f11ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:37.453401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833eb72-289f-4c13-8bc6-985035f11ab9 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:37.458988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 186/364] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:37 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:37.461326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833eb72-289f-4c13-8bc6-985035f11ab9 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:37.488277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:37.545981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:37.561098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e06a-e346-4dc2-93d7-d51e47a875b1 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.599849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833eb72-289f-4c13-8bc6-985035f11ab9 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.611234 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fe052-2f89-4b38-ba1f-51bd22c6d9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:37.612258 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fe052-2f89-4b38-ba1f-51bd22c6d9c7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.612739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fe052-2f89-4b38-ba1f-51bd22c6d9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.613299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fe052-2f89-4b38-ba1f-51bd22c6d9c7 None admin] PATH_INFO: `/v3/users/6476832729b642bea96df74ed3a37057` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.614692 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fe052-2f89-4b38-ba1f-51bd22c6d9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=6476832729b642bea96df74ed3a37057)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:37.616638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fe052-2f89-4b38-ba1f-51bd22c6d9c7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:37.618475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 179/365] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:32:37 2022] GET /identity/v3/users/6476832729b642bea96df74ed3a37057 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:37.619273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fe052-2f89-4b38-ba1f-51bd22c6d9c7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:37.651001 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a90ba-5fb9-4463-b9ce-1d08ec991e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:37.651935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a90ba-5fb9-4463-b9ce-1d08ec991e0b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.652391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a90ba-5fb9-4463-b9ce-1d08ec991e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.652836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a90ba-5fb9-4463-b9ce-1d08ec991e0b None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.654174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a90ba-5fb9-4463-b9ce-1d08ec991e0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:37.655080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a90ba-5fb9-4463-b9ce-1d08ec991e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:37.656896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a90ba-5fb9-4463-b9ce-1d08ec991e0b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:37.670040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 187/366] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:37.671223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a90ba-5fb9-4463-b9ce-1d08ec991e0b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:37.771948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fe052-2f89-4b38-ba1f-51bd22c6d9c7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.778923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:37.806504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a90ba-5fb9-4463-b9ce-1d08ec991e0b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.822464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51c7eb-1151-4875-82a6-de69f0d3c30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:37.823102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c7eb-1151-4875-82a6-de69f0d3c30d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.824965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c7eb-1151-4875-82a6-de69f0d3c30d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.824965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c7eb-1151-4875-82a6-de69f0d3c30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.824965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51c7eb-1151-4875-82a6-de69f0d3c30d None admin] RBAC: Adding query filter params (group.id=71a4ed5e1b0647e99575dacf405dac1c, role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=b0de385b20724662bfc182dd6a4c2641) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:37.824965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51c7eb-1151-4875-82a6-de69f0d3c30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:37.826086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51c7eb-1151-4875-82a6-de69f0d3c30d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:37.835266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 180/367] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:37 2022] GET /identity/v3/role_assignments?group.id=71a4ed5e1b0647e99575dacf405dac1c&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=40201003f53c4077b8e412e7d4450cab => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:37.836143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51c7eb-1151-4875-82a6-de69f0d3c30d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:37.861886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac3aa7-f517-4b8d-9b47-94bff36389cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:37.862958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac3aa7-f517-4b8d-9b47-94bff36389cd None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:37.864063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac3aa7-f517-4b8d-9b47-94bff36389cd None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:37.864581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac3aa7-f517-4b8d-9b47-94bff36389cd None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:37.866141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac3aa7-f517-4b8d-9b47-94bff36389cd None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:37.867558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:37.868327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac3aa7-f517-4b8d-9b47-94bff36389cd None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:37.870646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 188/368] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:37 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:37.871978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac3aa7-f517-4b8d-9b47-94bff36389cd None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:37.983328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51c7eb-1151-4875-82a6-de69f0d3c30d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:37.995663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac3aa7-f517-4b8d-9b47-94bff36389cd None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:38.023160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ebe81-c801-4bca-a150-9b985f128088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:38.023781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ebe81-c801-4bca-a150-9b985f128088 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:38.024057 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ebe81-c801-4bca-a150-9b985f128088 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:38.024328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ebe81-c801-4bca-a150-9b985f128088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:38.025079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ebe81-c801-4bca-a150-9b985f128088 None admin] RBAC: Adding query filter params (role.id=fcc7d8db3d7249f393782c75305077c2, user.id=6476832729b642bea96df74ed3a37057, scope.system=all) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:38.025386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ebe81-c801-4bca-a150-9b985f128088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:38.026832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ebe81-c801-4bca-a150-9b985f128088 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:38.041730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a416e-f54c-426e-ba6e-c9368a28c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:38.042441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a416e-f54c-426e-ba6e-c9368a28c9de None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:38.042836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a416e-f54c-426e-ba6e-c9368a28c9de None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:38.043202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a416e-f54c-426e-ba6e-c9368a28c9de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:38.044476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 181/369] 10.222.0.59 () {56 vars in 1308 bytes} [Wed Aug 24 11:32:37 2022] GET /identity/v3/role_assignments?user.id=6476832729b642bea96df74ed3a37057&scope.system=all&role.id=fcc7d8db3d7249f393782c75305077c2 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:38.045633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ebe81-c801-4bca-a150-9b985f128088 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:38.077695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:38.166083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a416e-f54c-426e-ba6e-c9368a28c9de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:38.168468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a416e-f54c-426e-ba6e-c9368a28c9de None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:38.172222 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:38.199784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ebe81-c801-4bca-a150-9b985f128088 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:38.245468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af604d2a-9fc9-45bd-b53b-1c9e92109f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:38.245468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604d2a-9fc9-45bd-b53b-1c9e92109f6a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:38.245739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604d2a-9fc9-45bd-b53b-1c9e92109f6a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:38.246071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604d2a-9fc9-45bd-b53b-1c9e92109f6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:38.268487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af604d2a-9fc9-45bd-b53b-1c9e92109f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-af604d2a-9fc9-45bd-b53b-1c9e92109f6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:38.277296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:38.278262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:38.279102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 182/370] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:32:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:38.283866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af604d2a-9fc9-45bd-b53b-1c9e92109f6a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:38.326865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 189/371] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:38.328190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a416e-f54c-426e-ba6e-c9368a28c9de None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:38.390855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:38.398994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af604d2a-9fc9-45bd-b53b-1c9e92109f6a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:38.436748 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369194a-f583-436d-9804-8eec4beea839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:38.438194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369194a-f583-436d-9804-8eec4beea839 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:38.438901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369194a-f583-436d-9804-8eec4beea839 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:38.439710 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369194a-f583-436d-9804-8eec4beea839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:38.440742 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369194a-f583-436d-9804-8eec4beea839 None admin] RBAC: Adding query filter params (group.id=71a4ed5e1b0647e99575dacf405dac1c, role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=f06373c3edbc40b1880f456b42cc666a) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:38.441250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369194a-f583-436d-9804-8eec4beea839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:38.443038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369194a-f583-436d-9804-8eec4beea839 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:38.449665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 183/372] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:38 2022] GET /identity/v3/role_assignments?group.id=71a4ed5e1b0647e99575dacf405dac1c&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:38.450644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a416e-f54c-426e-ba6e-c9368a28c9de None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:38.451421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369194a-f583-436d-9804-8eec4beea839 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:38.456514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:38.493210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cd536-3412-47ac-a0ee-647f87b3bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:38.494086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cd536-3412-47ac-a0ee-647f87b3bdbd None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:38.494541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cd536-3412-47ac-a0ee-647f87b3bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:38.495063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cd536-3412-47ac-a0ee-647f87b3bdbd None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:38.495955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cd536-3412-47ac-a0ee-647f87b3bdbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:38.496486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cd536-3412-47ac-a0ee-647f87b3bdbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:38.498151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cd536-3412-47ac-a0ee-647f87b3bdbd None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:38.509058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 190/373] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:38.515309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cd536-3412-47ac-a0ee-647f87b3bdbd None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:38.615029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369194a-f583-436d-9804-8eec4beea839 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:38.651997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cd536-3412-47ac-a0ee-647f87b3bdbd None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:38.671185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:38.698584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ac3b3-4bad-4d0c-bad9-89257df8174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:38.699622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac3b3-4bad-4d0c-bad9-89257df8174c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:38.700101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac3b3-4bad-4d0c-bad9-89257df8174c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:38.700850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac3b3-4bad-4d0c-bad9-89257df8174c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:38.728992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da4f2f-ba63-4131-b9ef-b48e159f7f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:38.729668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da4f2f-ba63-4131-b9ef-b48e159f7f5b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:38.729915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da4f2f-ba63-4131-b9ef-b48e159f7f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:38.730187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da4f2f-ba63-4131-b9ef-b48e159f7f5b None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:38.731371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da4f2f-ba63-4131-b9ef-b48e159f7f5b None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:38.732805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da4f2f-ba63-4131-b9ef-b48e159f7f5b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:38.734447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 184/374] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:38 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:38.740846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da4f2f-ba63-4131-b9ef-b48e159f7f5b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:38.789558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ac3b3-4bad-4d0c-bad9-89257df8174c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:38.791437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ac3b3-4bad-4d0c-bad9-89257df8174c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:38.836444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:38.872124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da4f2f-ba63-4131-b9ef-b48e159f7f5b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:38.912911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b386c-cce7-47ec-88f2-5d525b2ceb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:38.913551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b386c-cce7-47ec-88f2-5d525b2ceb9a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:38.913874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b386c-cce7-47ec-88f2-5d525b2ceb9a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:38.914136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b386c-cce7-47ec-88f2-5d525b2ceb9a None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:38.915840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b386c-cce7-47ec-88f2-5d525b2ceb9a None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:38.917205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b386c-cce7-47ec-88f2-5d525b2ceb9a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:38.919268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 185/375] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:38 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:38.925221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b386c-cce7-47ec-88f2-5d525b2ceb9a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:38.927762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 191/376] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:38.933650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ac3b3-4bad-4d0c-bad9-89257df8174c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:38.954930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:39.105008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b386c-cce7-47ec-88f2-5d525b2ceb9a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:39.118828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ac3b3-4bad-4d0c-bad9-89257df8174c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:39.175464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc027a-a37b-406a-9da6-f8f2542f6975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:39.176349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc027a-a37b-406a-9da6-f8f2542f6975 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:39.176770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc027a-a37b-406a-9da6-f8f2542f6975 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:39.177181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc027a-a37b-406a-9da6-f8f2542f6975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:39.178047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc027a-a37b-406a-9da6-f8f2542f6975 None admin] RBAC: Adding query filter params (group.id=71a4ed5e1b0647e99575dacf405dac1c, role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=f06373c3edbc40b1880f456b42cc666a) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:39.178671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc027a-a37b-406a-9da6-f8f2542f6975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:39.180731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc027a-a37b-406a-9da6-f8f2542f6975 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:39.187667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24dcc-0d8d-475f-8827-0b0d622bef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:39.188541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24dcc-0d8d-475f-8827-0b0d622bef87 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:39.188958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24dcc-0d8d-475f-8827-0b0d622bef87 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:39.189365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd24dcc-0d8d-475f-8827-0b0d622bef87 None admin] PATH_INFO: `/v3/projects/366850b748b7483f9a23090a350c7e5e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:39.191589 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd24dcc-0d8d-475f-8827-0b0d622bef87 None admin] RBAC: Authorizing `identity:get_project(project_id=366850b748b7483f9a23090a350c7e5e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:39.193156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd24dcc-0d8d-475f-8827-0b0d622bef87 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:39.194404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 186/377] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:38 2022] GET /identity/v3/role_assignments?group.id=71a4ed5e1b0647e99575dacf405dac1c&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=40201003f53c4077b8e412e7d4450cab => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:39.200744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 192/378] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:38 2022] GET /identity/v3/projects/366850b748b7483f9a23090a350c7e5e => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:39.206653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc027a-a37b-406a-9da6-f8f2542f6975 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:39.221126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:39.345718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc027a-a37b-406a-9da6-f8f2542f6975 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:39.387036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838b400-310c-4459-82c9-0df40b0d7800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:39.387927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b400-310c-4459-82c9-0df40b0d7800 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:39.388368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b400-310c-4459-82c9-0df40b0d7800 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:39.388795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b400-310c-4459-82c9-0df40b0d7800 None admin] PATH_INFO: `/v3/groups/44fbdec0ade74011b3c50d59822fb448` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:39.400536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838b400-310c-4459-82c9-0df40b0d7800 None admin] RBAC: Authorizing `identity:get_group(group_id=44fbdec0ade74011b3c50d59822fb448)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:39.402227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838b400-310c-4459-82c9-0df40b0d7800 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:39.404442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 187/379] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:39 2022] GET /identity/v3/groups/44fbdec0ade74011b3c50d59822fb448 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:39.410979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24dcc-0d8d-475f-8827-0b0d622bef87 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:39.492207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1669eb-c1e5-4e07-b759-4668d0a65979 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:39.492680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1669eb-c1e5-4e07-b759-4668d0a65979 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:39.492680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1669eb-c1e5-4e07-b759-4668d0a65979 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:39.494118 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 188/380] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:39.499771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5549344-69d1-4544-9176-f3b9dc83f624 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:39.500381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5549344-69d1-4544-9176-f3b9dc83f624 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:39.501034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5549344-69d1-4544-9176-f3b9dc83f624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:39.519044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:39.529037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d5549344-69d1-4544-9176-f3b9dc83f624 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:39.530604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d5549344-69d1-4544-9176-f3b9dc83f624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:39.556088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd24dcc-0d8d-475f-8827-0b0d622bef87 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:39.600544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b6e4f-c274-4c58-a75c-3d5e70248feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:39.601214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b6e4f-c274-4c58-a75c-3d5e70248feb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:39.601497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b6e4f-c274-4c58-a75c-3d5e70248feb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:39.601771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b6e4f-c274-4c58-a75c-3d5e70248feb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:39.602493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b6e4f-c274-4c58-a75c-3d5e70248feb None admin] RBAC: Adding query filter params (group.id=44fbdec0ade74011b3c50d59822fb448, role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=366850b748b7483f9a23090a350c7e5e) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:39.602857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b6e4f-c274-4c58-a75c-3d5e70248feb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:39.604398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b6e4f-c274-4c58-a75c-3d5e70248feb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:39.613327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 193/381] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:39 2022] GET /identity/v3/role_assignments?group.id=44fbdec0ade74011b3c50d59822fb448&scope.project.id=366850b748b7483f9a23090a350c7e5e&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:39.622958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:39.633814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 189/382] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:40.069796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b6e4f-c274-4c58-a75c-3d5e70248feb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:40.195465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b6e4f-c274-4c58-a75c-3d5e70248feb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:40.246713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95ac2c-9bd6-4d2d-bde2-9d3ab9943113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:40.247376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95ac2c-9bd6-4d2d-bde2-9d3ab9943113 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:40.247715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95ac2c-9bd6-4d2d-bde2-9d3ab9943113 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:40.247989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95ac2c-9bd6-4d2d-bde2-9d3ab9943113 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:40.264464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95ac2c-9bd6-4d2d-bde2-9d3ab9943113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-5a95ac2c-9bd6-4d2d-bde2-9d3ab9943113 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:40.270327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:40.271247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:40.272028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 194/383] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:40.279884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5549344-69d1-4544-9176-f3b9dc83f624 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:40.436286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5549344-69d1-4544-9176-f3b9dc83f624 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:40.473011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49e0b-a231-40a7-a63f-32f0ae21d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:40.474028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49e0b-a231-40a7-a63f-32f0ae21d36a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:40.474529 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49e0b-a231-40a7-a63f-32f0ae21d36a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:40.475026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49e0b-a231-40a7-a63f-32f0ae21d36a None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:40.475919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c49e0b-a231-40a7-a63f-32f0ae21d36a None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:40.476419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c49e0b-a231-40a7-a63f-32f0ae21d36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:40.477979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c49e0b-a231-40a7-a63f-32f0ae21d36a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:40.488101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 190/384] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:40.492010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab032f-c70f-4014-926e-a6ea739f3c6a None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:40.492010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab032f-c70f-4014-926e-a6ea739f3c6a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:40.492010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab032f-c70f-4014-926e-a6ea739f3c6a None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:40.492914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 195/385] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:40.494466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49e0b-a231-40a7-a63f-32f0ae21d36a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:40.498136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d731-1e71-4a4c-b2aa-5dc984e55672 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:40.498359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d731-1e71-4a4c-b2aa-5dc984e55672 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:40.498645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d731-1e71-4a4c-b2aa-5dc984e55672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:40.506430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:40.536053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-8b59d731-1e71-4a4c-b2aa-5dc984e55672 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:40.537290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8b59d731-1e71-4a4c-b2aa-5dc984e55672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:40.568972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:40.614184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49e0b-a231-40a7-a63f-32f0ae21d36a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:40.651259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf945b-de57-4c82-8f1d-1802b986f311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:40.652264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf945b-de57-4c82-8f1d-1802b986f311 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:40.652766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf945b-de57-4c82-8f1d-1802b986f311 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:40.653237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf945b-de57-4c82-8f1d-1802b986f311 None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:40.654681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf945b-de57-4c82-8f1d-1802b986f311 None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:40.656446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf945b-de57-4c82-8f1d-1802b986f311 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:40.659557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 191/386] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:40 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:40.670889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf945b-de57-4c82-8f1d-1802b986f311 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:40.711061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 196/387] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:40.832681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf945b-de57-4c82-8f1d-1802b986f311 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:40.865200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:40.877356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7547dc0-4c84-4c23-9c91-1624fe18f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:40.878206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7547dc0-4c84-4c23-9c91-1624fe18f17a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:40.878491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7547dc0-4c84-4c23-9c91-1624fe18f17a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:40.878790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7547dc0-4c84-4c23-9c91-1624fe18f17a None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:40.879987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7547dc0-4c84-4c23-9c91-1624fe18f17a None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:40.881446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7547dc0-4c84-4c23-9c91-1624fe18f17a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:40.883975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 192/388] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:40 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:40.889388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59d731-1e71-4a4c-b2aa-5dc984e55672 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:41.015219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59d731-1e71-4a4c-b2aa-5dc984e55672 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:41.048485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:41.058262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733586-8909-444b-9474-93a98191f2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:41.058966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733586-8909-444b-9474-93a98191f2b6 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.059251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733586-8909-444b-9474-93a98191f2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.059530 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733586-8909-444b-9474-93a98191f2b6 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641/groups/71a4ed5e1b0647e99575dacf405dac1c/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.065227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a733586-8909-444b-9474-93a98191f2b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0de385b20724662bfc182dd6a4c2641, group_id=71a4ed5e1b0647e99575dacf405dac1c, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:41.066757 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a733586-8909-444b-9474-93a98191f2b6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:41.088976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 197/389] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 11:32:40 2022] PUT /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641/groups/71a4ed5e1b0647e99575dacf405dac1c/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:41.101745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c76782-cc8d-4436-a4a0-fc4639d8434e None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.102067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c76782-cc8d-4436-a4a0-fc4639d8434e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.102318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c76782-cc8d-4436-a4a0-fc4639d8434e None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.103978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 193/390] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:41.109696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3e346-7601-40df-8b53-845c3cff0218 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.109987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3e346-7601-40df-8b53-845c3cff0218 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.110867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3e346-7601-40df-8b53-845c3cff0218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.136514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-17d3e346-7601-40df-8b53-845c3cff0218 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:41.137767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-17d3e346-7601-40df-8b53-845c3cff0218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:41.176457 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c76782-cc8d-4436-a4a0-fc4639d8434e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:41.280203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 198/391] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:41.311980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c76782-cc8d-4436-a4a0-fc4639d8434e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:41.351622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a930e-3284-48ce-8c60-1e12a98d6dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:41.352259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a930e-3284-48ce-8c60-1e12a98d6dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.352548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a930e-3284-48ce-8c60-1e12a98d6dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.352826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a930e-3284-48ce-8c60-1e12a98d6dc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a930e-3284-48ce-8c60-1e12a98d6dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-387a930e-3284-48ce-8c60-1e12a98d6dc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:41.371191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:41.372184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:41.372956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 194/392] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:41.379120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3e346-7601-40df-8b53-845c3cff0218 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:41.528589 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3e346-7601-40df-8b53-845c3cff0218 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:41.561252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:41.572539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a930e-3284-48ce-8c60-1e12a98d6dc4 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:41.581164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb797f7-2b49-4b6e-a606-85745356a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:41.581807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb797f7-2b49-4b6e-a606-85745356a9cb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.582093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb797f7-2b49-4b6e-a606-85745356a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.582370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb797f7-2b49-4b6e-a606-85745356a9cb None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.583107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb797f7-2b49-4b6e-a606-85745356a9cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:41.583414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb797f7-2b49-4b6e-a606-85745356a9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:41.584854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb797f7-2b49-4b6e-a606-85745356a9cb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:41.602371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 199/393] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:41.609343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb797f7-2b49-4b6e-a606-85745356a9cb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:41.666429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:41.731202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb797f7-2b49-4b6e-a606-85745356a9cb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:41.744890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a930e-3284-48ce-8c60-1e12a98d6dc4 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:41.768558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c12f-28c5-4e39-8168-de2192401340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:41.769564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c12f-28c5-4e39-8168-de2192401340 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.770051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c12f-28c5-4e39-8168-de2192401340 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.770582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c12f-28c5-4e39-8168-de2192401340 None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.771957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c12f-28c5-4e39-8168-de2192401340 None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:41.773687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c12f-28c5-4e39-8168-de2192401340 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:41.775830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 200/394] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:41 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:41.781439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797f5d2-6948-48b9-a1fc-7200373b3283 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.781439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797f5d2-6948-48b9-a1fc-7200373b3283 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.781439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797f5d2-6948-48b9-a1fc-7200373b3283 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.781439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 201/395] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:41.785411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797f5d2-6948-48b9-a1fc-7200373b3283 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:41.789401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa062806-e023-42c6-bf76-b3d2ecd4e9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:41.791235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa062806-e023-42c6-bf76-b3d2ecd4e9b8 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.791741 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa062806-e023-42c6-bf76-b3d2ecd4e9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.792231 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa062806-e023-42c6-bf76-b3d2ecd4e9b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.807107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa062806-e023-42c6-bf76-b3d2ecd4e9b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-aa062806-e023-42c6-bf76-b3d2ecd4e9b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:41.815528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:41.816611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:41.817446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:41.824505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 195/396] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:41.824505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9690a-049a-4963-bbc7-534866f5c494 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.825000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9690a-049a-4963-bbc7-534866f5c494 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.825245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9690a-049a-4963-bbc7-534866f5c494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.854643 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-7fb9690a-049a-4963-bbc7-534866f5c494 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:41.856363 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7fb9690a-049a-4963-bbc7-534866f5c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:41.863647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:41.918577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797f5d2-6948-48b9-a1fc-7200373b3283 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:41.954792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 196/397] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:41.954792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9690a-049a-4963-bbc7-534866f5c494 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:41.972129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378a7aa-ad06-4597-b923-4e2070d1d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:41.973202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378a7aa-ad06-4597-b923-4e2070d1d461 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:41.973689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378a7aa-ad06-4597-b923-4e2070d1d461 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:41.974183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378a7aa-ad06-4597-b923-4e2070d1d461 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:41.975648 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378a7aa-ad06-4597-b923-4e2070d1d461 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:41.977284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378a7aa-ad06-4597-b923-4e2070d1d461 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:41.979611 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 202/398] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:41 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:41.987777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378a7aa-ad06-4597-b923-4e2070d1d461 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:42.000075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:42.058976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9690a-049a-4963-bbc7-534866f5c494 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:42.096471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01208c12-a766-4074-aec0-3764fee4f1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:42.097474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01208c12-a766-4074-aec0-3764fee4f1af None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:42.097952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01208c12-a766-4074-aec0-3764fee4f1af None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:42.098422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01208c12-a766-4074-aec0-3764fee4f1af None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:42.099314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01208c12-a766-4074-aec0-3764fee4f1af None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:42.099820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01208c12-a766-4074-aec0-3764fee4f1af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:42.101388 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01208c12-a766-4074-aec0-3764fee4f1af None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:42.111588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 197/399] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:42.116790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01208c12-a766-4074-aec0-3764fee4f1af None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:42.188121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378a7aa-ad06-4597-b923-4e2070d1d461 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:42.209272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:42.225512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43159e1b-8dbe-4643-8fd8-dd9767fd5ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:42.226177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43159e1b-8dbe-4643-8fd8-dd9767fd5ad6 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:42.226457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43159e1b-8dbe-4643-8fd8-dd9767fd5ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:42.226730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43159e1b-8dbe-4643-8fd8-dd9767fd5ad6 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641/groups/71a4ed5e1b0647e99575dacf405dac1c/roles/40201003f53c4077b8e412e7d4450cab` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:42.229047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43159e1b-8dbe-4643-8fd8-dd9767fd5ad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0de385b20724662bfc182dd6a4c2641, group_id=71a4ed5e1b0647e99575dacf405dac1c, role_id=40201003f53c4077b8e412e7d4450cab)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:42.230347 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43159e1b-8dbe-4643-8fd8-dd9767fd5ad6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:42.249510 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 203/400] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 11:32:41 2022] PUT /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641/groups/71a4ed5e1b0647e99575dacf405dac1c/roles/40201003f53c4077b8e412e7d4450cab => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:42.251759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01208c12-a766-4074-aec0-3764fee4f1af None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:42.263214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:42.302516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433fc5c-fb9c-4203-aa82-1c09175c278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:42.303535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433fc5c-fb9c-4203-aa82-1c09175c278c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:42.304045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433fc5c-fb9c-4203-aa82-1c09175c278c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:42.304550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433fc5c-fb9c-4203-aa82-1c09175c278c None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:42.305907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433fc5c-fb9c-4203-aa82-1c09175c278c None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:42.307575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433fc5c-fb9c-4203-aa82-1c09175c278c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:42.309790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 198/401] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:42 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:42.315321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43159e1b-8dbe-4643-8fd8-dd9767fd5ad6 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:42.415284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433fc5c-fb9c-4203-aa82-1c09175c278c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:42.504167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43159e1b-8dbe-4643-8fd8-dd9767fd5ad6 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:42.561682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0aaf7-8039-4c0d-a686-d49946fafdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:42.562357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0aaf7-8039-4c0d-a686-d49946fafdb2 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:42.562626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0aaf7-8039-4c0d-a686-d49946fafdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:42.562920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0aaf7-8039-4c0d-a686-d49946fafdb2 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:42.564837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0aaf7-8039-4c0d-a686-d49946fafdb2 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:42.567246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0aaf7-8039-4c0d-a686-d49946fafdb2 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:42.569250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 204/402] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:42 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:42.569380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433fc5c-fb9c-4203-aa82-1c09175c278c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:42.575193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0d4dd-837d-41b8-a509-cd1f973b11ac None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:42.575518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0d4dd-837d-41b8-a509-cd1f973b11ac None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:42.575796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0d4dd-837d-41b8-a509-cd1f973b11ac None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:42.577257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 205/403] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:42.577820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0d4dd-837d-41b8-a509-cd1f973b11ac None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:42.616473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f07817-5044-438a-b13d-a92c85fd16e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:42.617140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07817-5044-438a-b13d-a92c85fd16e8 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:42.617383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07817-5044-438a-b13d-a92c85fd16e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:42.617706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07817-5044-438a-b13d-a92c85fd16e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:42.629357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f07817-5044-438a-b13d-a92c85fd16e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-14f07817-5044-438a-b13d-a92c85fd16e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:42.635159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:42.636018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:42.636834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 199/404] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:42.637960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e401e4-2733-4c1c-b233-9892e20e2032 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:42.638088 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e401e4-2733-4c1c-b233-9892e20e2032 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:42.638347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e401e4-2733-4c1c-b233-9892e20e2032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:42.650751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:42.666851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-89e401e4-2733-4c1c-b233-9892e20e2032 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:42.667965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-89e401e4-2733-4c1c-b233-9892e20e2032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:42.701915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:42.723771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0d4dd-837d-41b8-a509-cd1f973b11ac None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:42.761945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb819-a9ff-45b9-bc5e-529a40105570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:42.762617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb819-a9ff-45b9-bc5e-529a40105570 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:42.762956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb819-a9ff-45b9-bc5e-529a40105570 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:42.763240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb819-a9ff-45b9-bc5e-529a40105570 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a/groups/71a4ed5e1b0647e99575dacf405dac1c/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:42.765173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeb819-a9ff-45b9-bc5e-529a40105570 None admin] RBAC: Authorizing `identity:create_grant(project_id=f06373c3edbc40b1880f456b42cc666a, group_id=71a4ed5e1b0647e99575dacf405dac1c, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:42.765401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 200/405] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:42.766659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e401e4-2733-4c1c-b233-9892e20e2032 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:42.766889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeb819-a9ff-45b9-bc5e-529a40105570 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:42.788359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 206/406] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 11:32:42 2022] PUT /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a/groups/71a4ed5e1b0647e99575dacf405dac1c/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:42.893176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e401e4-2733-4c1c-b233-9892e20e2032 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:42.948322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048b3af-a641-4f8a-931c-86dd330fd169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:42.949030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048b3af-a641-4f8a-931c-86dd330fd169 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:42.949309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048b3af-a641-4f8a-931c-86dd330fd169 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:42.949582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048b3af-a641-4f8a-931c-86dd330fd169 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:42.950262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048b3af-a641-4f8a-931c-86dd330fd169 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:42.950565 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048b3af-a641-4f8a-931c-86dd330fd169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:42.951982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048b3af-a641-4f8a-931c-86dd330fd169 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:42.968169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb819-a9ff-45b9-bc5e-529a40105570 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:42.969263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 201/407] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:43.100346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb819-a9ff-45b9-bc5e-529a40105570 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:43.100677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048b3af-a641-4f8a-931c-86dd330fd169 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:43.111228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:43.138684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd46e97-30a5-497c-8ada-1a3b4aaed578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:43.139395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd46e97-30a5-497c-8ada-1a3b4aaed578 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:43.139676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd46e97-30a5-497c-8ada-1a3b4aaed578 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:43.139950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd46e97-30a5-497c-8ada-1a3b4aaed578 None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:43.141157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd46e97-30a5-497c-8ada-1a3b4aaed578 None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:43.143623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd46e97-30a5-497c-8ada-1a3b4aaed578 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:43.149742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 207/408] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:42 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:43.151143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd46e97-30a5-497c-8ada-1a3b4aaed578 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:43.158681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:43.242229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048b3af-a641-4f8a-931c-86dd330fd169 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:43.278107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd46e97-30a5-497c-8ada-1a3b4aaed578 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:43.280801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d740d-cbf3-4907-9185-e170b994e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:43.281680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d740d-cbf3-4907-9185-e170b994e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:43.282884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d740d-cbf3-4907-9185-e170b994e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:43.283356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d740d-cbf3-4907-9185-e170b994e9f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:43.294912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d740d-cbf3-4907-9185-e170b994e9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-7f6d740d-cbf3-4907-9185-e170b994e9f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:43.301488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:43.302396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:43.303227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:43.305926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 202/409] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:43.316212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2fb85-be4b-4be2-9fdd-b61f08e0f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:43.316385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d740d-cbf3-4907-9185-e170b994e9f1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:43.316854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2fb85-be4b-4be2-9fdd-b61f08e0f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:43.317132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2fb85-be4b-4be2-9fdd-b61f08e0f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:43.317482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2fb85-be4b-4be2-9fdd-b61f08e0f9c0 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:43.318680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2fb85-be4b-4be2-9fdd-b61f08e0f9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:43.321978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2fb85-be4b-4be2-9fdd-b61f08e0f9c0 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:43.323906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 208/410] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:43 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:43.337316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2fb85-be4b-4be2-9fdd-b61f08e0f9c0 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:43.410388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:43.436789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:43.451239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d740d-cbf3-4907-9185-e170b994e9f1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:43.460170 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2fb85-be4b-4be2-9fdd-b61f08e0f9c0 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:43.489712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb3a2-f955-45ea-9c29-8b98e997b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:43.490199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb3a2-f955-45ea-9c29-8b98e997b167 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:43.490485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb3a2-f955-45ea-9c29-8b98e997b167 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:43.490760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb3a2-f955-45ea-9c29-8b98e997b167 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:43.491459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eb3a2-f955-45ea-9c29-8b98e997b167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:43.491768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eb3a2-f955-45ea-9c29-8b98e997b167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:43.494915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eb3a2-f955-45ea-9c29-8b98e997b167 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:43.499101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8e971-e3ac-4409-9c68-376db5fed33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:43.500037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8e971-e3ac-4409-9c68-376db5fed33b None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:43.500573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8e971-e3ac-4409-9c68-376db5fed33b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:43.502013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8e971-e3ac-4409-9c68-376db5fed33b None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a/groups/71a4ed5e1b0647e99575dacf405dac1c/roles/40201003f53c4077b8e412e7d4450cab` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:43.504646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 203/411] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:43.505014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8e971-e3ac-4409-9c68-376db5fed33b None admin] RBAC: Authorizing `identity:create_grant(project_id=f06373c3edbc40b1880f456b42cc666a, group_id=71a4ed5e1b0647e99575dacf405dac1c, role_id=40201003f53c4077b8e412e7d4450cab)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:43.505966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f64fd-6f34-43fc-a79c-fbfdad587859 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:43.506262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f64fd-6f34-43fc-a79c-fbfdad587859 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:43.506541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f64fd-6f34-43fc-a79c-fbfdad587859 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:43.507507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8e971-e3ac-4409-9c68-376db5fed33b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:43.507927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 204/412] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:43.513108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f64fd-6f34-43fc-a79c-fbfdad587859 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:43.524127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 209/413] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 11:32:43 2022] PUT /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a/groups/71a4ed5e1b0647e99575dacf405dac1c/roles/40201003f53c4077b8e412e7d4450cab => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:43.532511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926e4a4-e4f5-4dfc-a26a-2e005c814538 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:43.533420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926e4a4-e4f5-4dfc-a26a-2e005c814538 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:43.533932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926e4a4-e4f5-4dfc-a26a-2e005c814538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:43.564740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a926e4a4-e4f5-4dfc-a26a-2e005c814538 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:43.566942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a926e4a4-e4f5-4dfc-a26a-2e005c814538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:43.648401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 210/414] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:43.705428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f64fd-6f34-43fc-a79c-fbfdad587859 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:43.744455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fbf7b-e767-4eea-ba72-cd54d3898800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:43.745217 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fbf7b-e767-4eea-ba72-cd54d3898800 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:43.745434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fbf7b-e767-4eea-ba72-cd54d3898800 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:43.745701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fbf7b-e767-4eea-ba72-cd54d3898800 None admin] PATH_INFO: `/v3/groups/44fbdec0ade74011b3c50d59822fb448` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:43.747017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fbf7b-e767-4eea-ba72-cd54d3898800 None admin] RBAC: Authorizing `identity:get_group(group_id=44fbdec0ade74011b3c50d59822fb448)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:43.748598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fbf7b-e767-4eea-ba72-cd54d3898800 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:43.750660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 205/415] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:43 2022] GET /identity/v3/groups/44fbdec0ade74011b3c50d59822fb448 => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:43.756847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926e4a4-e4f5-4dfc-a26a-2e005c814538 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:43.793495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:43.866196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926e4a4-e4f5-4dfc-a26a-2e005c814538 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:43.905021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6f99-f51f-4716-94fa-cd75d124a8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:43.905660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6f99-f51f-4716-94fa-cd75d124a8f2 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:43.905989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6f99-f51f-4716-94fa-cd75d124a8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:43.906261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d6f99-f51f-4716-94fa-cd75d124a8f2 None admin] PATH_INFO: `/v3/projects/366850b748b7483f9a23090a350c7e5e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:43.908010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d6f99-f51f-4716-94fa-cd75d124a8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=366850b748b7483f9a23090a350c7e5e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:43.909870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d6f99-f51f-4716-94fa-cd75d124a8f2 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:43.911815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 211/416] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:43 2022] GET /identity/v3/projects/366850b748b7483f9a23090a350c7e5e => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:43.917959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fbf7b-e767-4eea-ba72-cd54d3898800 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:43.948137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:44.001117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6f99-f51f-4716-94fa-cd75d124a8f2 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:44.083163 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fbf7b-e767-4eea-ba72-cd54d3898800 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:44.121422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4a54-9125-4eb3-810a-dfc05732b640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:44.122171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4a54-9125-4eb3-810a-dfc05732b640 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:44.122444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4a54-9125-4eb3-810a-dfc05732b640 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:44.122720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4a54-9125-4eb3-810a-dfc05732b640 None admin] PATH_INFO: `/v3/projects/366850b748b7483f9a23090a350c7e5e/groups/44fbdec0ade74011b3c50d59822fb448/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:44.124731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a4a54-9125-4eb3-810a-dfc05732b640 None admin] RBAC: Authorizing `identity:create_grant(project_id=366850b748b7483f9a23090a350c7e5e, group_id=44fbdec0ade74011b3c50d59822fb448, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:44.127855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a4a54-9125-4eb3-810a-dfc05732b640 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:44.151550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 206/417] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 11:32:43 2022] PUT /identity/v3/projects/366850b748b7483f9a23090a350c7e5e/groups/44fbdec0ade74011b3c50d59822fb448/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:32:44.174612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d6f99-f51f-4716-94fa-cd75d124a8f2 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:44.176330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:44.221914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6675f-575d-48f7-bad4-e12eac541b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:44.223104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6675f-575d-48f7-bad4-e12eac541b06 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:44.223605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6675f-575d-48f7-bad4-e12eac541b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:44.224087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6675f-575d-48f7-bad4-e12eac541b06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:44.237344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6675f-575d-48f7-bad4-e12eac541b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-82e6675f-575d-48f7-bad4-e12eac541b06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:44.242839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:44.243783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:44.244684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:44.247681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 212/418] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:44.254411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4a54-9125-4eb3-810a-dfc05732b640 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:44.383583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:44.411255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4a54-9125-4eb3-810a-dfc05732b640 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:44.450312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea0921-3478-4fda-b42f-ddd07bd4d26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:44.450968 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0921-3478-4fda-b42f-ddd07bd4d26a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:44.451250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0921-3478-4fda-b42f-ddd07bd4d26a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:44.451592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0921-3478-4fda-b42f-ddd07bd4d26a None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:44.452316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea0921-3478-4fda-b42f-ddd07bd4d26a None admin] RBAC: Adding query filter params (name=member) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:44.452618 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea0921-3478-4fda-b42f-ddd07bd4d26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:44.454056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea0921-3478-4fda-b42f-ddd07bd4d26a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:44.464135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 207/419] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:44.469496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6675f-575d-48f7-bad4-e12eac541b06 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:44.651124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6675f-575d-48f7-bad4-e12eac541b06 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:44.706639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3eec5-8126-4945-a7a3-8188317cff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:44.707290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3eec5-8126-4945-a7a3-8188317cff79 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:44.707578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3eec5-8126-4945-a7a3-8188317cff79 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:44.707855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3eec5-8126-4945-a7a3-8188317cff79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:44.748209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:44.801165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3eec5-8126-4945-a7a3-8188317cff79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:44.802697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3eec5-8126-4945-a7a3-8188317cff79 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:44.841594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808f8ec-c84e-4fe9-b01c-59c8bfedf8c4 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:44.842097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808f8ec-c84e-4fe9-b01c-59c8bfedf8c4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:44.842202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808f8ec-c84e-4fe9-b01c-59c8bfedf8c4 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:44.843603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 208/420] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:32:44.850224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4d89-82ae-49c3-b782-560ce13229bc None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:44.850556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4d89-82ae-49c3-b782-560ce13229bc None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:44.850860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4d89-82ae-49c3-b782-560ce13229bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:44.886757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ca2b4d89-82ae-49c3-b782-560ce13229bc None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:44.888955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ca2b4d89-82ae-49c3-b782-560ce13229bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:44.998659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 213/421] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:45.004147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 209/422] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:45.005182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3eec5-8126-4945-a7a3-8188317cff79 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:45.097173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:45.140598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3eec5-8126-4945-a7a3-8188317cff79 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:45.177193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75863b7-49c0-4676-8ab9-0c7749a2fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:45.177828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75863b7-49c0-4676-8ab9-0c7749a2fa11 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:45.178110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75863b7-49c0-4676-8ab9-0c7749a2fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:45.178382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75863b7-49c0-4676-8ab9-0c7749a2fa11 None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:45.179535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75863b7-49c0-4676-8ab9-0c7749a2fa11 None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:45.180983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75863b7-49c0-4676-8ab9-0c7749a2fa11 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:45.186874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 214/423] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:45 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:45.189022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4d89-82ae-49c3-b782-560ce13229bc None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:45.260665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:45.303743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b802-caf1-449d-a561-32b389b4bdcb None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:45.304057 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b802-caf1-449d-a561-32b389b4bdcb None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:45.304376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b802-caf1-449d-a561-32b389b4bdcb None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:45.305852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 215/424] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:32:45.311074 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d968d-2ab8-4163-9ed8-74c2b7e96f50 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:45.311356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d968d-2ab8-4163-9ed8-74c2b7e96f50 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:45.311629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d968d-2ab8-4163-9ed8-74c2b7e96f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:45.312205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4d89-82ae-49c3-b782-560ce13229bc None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:45.347766 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-5c5d968d-2ab8-4163-9ed8-74c2b7e96f50 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:45.348974 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5c5d968d-2ab8-4163-9ed8-74c2b7e96f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:45.350594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d8374-596f-4c09-822a-627325192e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:45.351306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d8374-596f-4c09-822a-627325192e5c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:45.351596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d8374-596f-4c09-822a-627325192e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:45.351878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d8374-596f-4c09-822a-627325192e5c None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:45.353131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d8374-596f-4c09-822a-627325192e5c None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:45.354702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d8374-596f-4c09-822a-627325192e5c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:45.361843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 210/425] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:45 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:45.363108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d8374-596f-4c09-822a-627325192e5c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:45.489679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d8374-596f-4c09-822a-627325192e5c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:45.531203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 216/426] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:45.532064 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d968d-2ab8-4163-9ed8-74c2b7e96f50 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:45.545722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b92a6a-6310-41d3-8c39-9b7362ab5c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:45.546349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b92a6a-6310-41d3-8c39-9b7362ab5c8b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:45.546631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b92a6a-6310-41d3-8c39-9b7362ab5c8b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:45.546967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b92a6a-6310-41d3-8c39-9b7362ab5c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:45.547730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b92a6a-6310-41d3-8c39-9b7362ab5c8b None admin] RBAC: Adding query filter params (group.id=71a4ed5e1b0647e99575dacf405dac1c, role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=b0de385b20724662bfc182dd6a4c2641) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:45.548043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b92a6a-6310-41d3-8c39-9b7362ab5c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:45.549537 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b92a6a-6310-41d3-8c39-9b7362ab5c8b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:45.569459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 211/427] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:45 2022] GET /identity/v3/role_assignments?group.id=71a4ed5e1b0647e99575dacf405dac1c&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:45.618374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:45.687522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d968d-2ab8-4163-9ed8-74c2b7e96f50 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:45.740818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea97f7-087c-46fe-b92e-da849b21b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:45.741498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea97f7-087c-46fe-b92e-da849b21b482 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:45.741746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea97f7-087c-46fe-b92e-da849b21b482 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:45.742015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea97f7-087c-46fe-b92e-da849b21b482 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:45.759246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea97f7-087c-46fe-b92e-da849b21b482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-3dea97f7-087c-46fe-b92e-da849b21b482 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:45.764263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:45.765150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:45.766087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 217/428] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:45.771306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b92a6a-6310-41d3-8c39-9b7362ab5c8b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:45.774206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:45.875086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea97f7-087c-46fe-b92e-da849b21b482 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:45.919375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b92a6a-6310-41d3-8c39-9b7362ab5c8b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:45.967631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41aa76-3fc4-4696-828c-42e6b95cb329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:45.968254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41aa76-3fc4-4696-828c-42e6b95cb329 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:45.968535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41aa76-3fc4-4696-828c-42e6b95cb329 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:45.969215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41aa76-3fc4-4696-828c-42e6b95cb329 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:45.969981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41aa76-3fc4-4696-828c-42e6b95cb329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:45.970284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41aa76-3fc4-4696-828c-42e6b95cb329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:45.971898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41aa76-3fc4-4696-828c-42e6b95cb329 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:45.984415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 212/429] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:45.991552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41aa76-3fc4-4696-828c-42e6b95cb329 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:46.037602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea97f7-087c-46fe-b92e-da849b21b482 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:46.065190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:46.082016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:46.087382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac45083-11f3-469a-9a2b-bb639f8b4e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:46.089480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac45083-11f3-469a-9a2b-bb639f8b4e65 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.090279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac45083-11f3-469a-9a2b-bb639f8b4e65 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.090916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac45083-11f3-469a-9a2b-bb639f8b4e65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.106972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac45083-11f3-469a-9a2b-bb639f8b4e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-1ac45083-11f3-469a-9a2b-bb639f8b4e65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:46.113924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:46.114898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 11:32:46.115920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:46.118186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 218/430] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:46.119579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4fbee-fb5d-4e9c-80f9-8c718de866a4 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.119999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4fbee-fb5d-4e9c-80f9-8c718de866a4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.120419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4fbee-fb5d-4e9c-80f9-8c718de866a4 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.129809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 219/431] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:46.129809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4fbee-fb5d-4e9c-80f9-8c718de866a4 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:46.130049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41aa76-3fc4-4696-828c-42e6b95cb329 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:46.181980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725fcc6-11b1-4fcc-ad08-8e01c9c94bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:46.182608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725fcc6-11b1-4fcc-ad08-8e01c9c94bce None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.182934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725fcc6-11b1-4fcc-ad08-8e01c9c94bce None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.183215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725fcc6-11b1-4fcc-ad08-8e01c9c94bce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.270495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4fbee-fb5d-4e9c-80f9-8c718de866a4 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:46.284098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725fcc6-11b1-4fcc-ad08-8e01c9c94bce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:46.285399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725fcc6-11b1-4fcc-ad08-8e01c9c94bce None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:46.322297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df14cff-d7a9-42d9-b664-029f5449dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:46.322957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df14cff-d7a9-42d9-b664-029f5449dd75 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.323239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df14cff-d7a9-42d9-b664-029f5449dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.324043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df14cff-d7a9-42d9-b664-029f5449dd75 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.324178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df14cff-d7a9-42d9-b664-029f5449dd75 None admin] RBAC: Adding query filter params (name=member) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:46.324818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df14cff-d7a9-42d9-b664-029f5449dd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:46.325828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df14cff-d7a9-42d9-b664-029f5449dd75 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:46.336843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 220/432] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:46.338156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dfcb-b062-4147-b062-df9af23b367a None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.338446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dfcb-b062-4147-b062-df9af23b367a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.338722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dfcb-b062-4147-b062-df9af23b367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.363324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-7301dfcb-b062-4147-b062-df9af23b367a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:46.364547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7301dfcb-b062-4147-b062-df9af23b367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:46.366900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:46.407863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:46.416957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 213/433] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:46.422435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725fcc6-11b1-4fcc-ad08-8e01c9c94bce None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:46.445473 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 221/434] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:46.446323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dfcb-b062-4147-b062-df9af23b367a None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:46.552272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dfcb-b062-4147-b062-df9af23b367a None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:46.560629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725fcc6-11b1-4fcc-ad08-8e01c9c94bce None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:46.592325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b73d3-da58-4540-9e3d-9a708695821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:46.592968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b73d3-da58-4540-9e3d-9a708695821a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.593248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b73d3-da58-4540-9e3d-9a708695821a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.593525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b73d3-da58-4540-9e3d-9a708695821a None admin] PATH_INFO: `/v3/projects/b0de385b20724662bfc182dd6a4c2641` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.595424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b73d3-da58-4540-9e3d-9a708695821a None admin] RBAC: Authorizing `identity:get_project(project_id=b0de385b20724662bfc182dd6a4c2641)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:46.597222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b73d3-da58-4540-9e3d-9a708695821a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:46.603496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 222/435] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:46 2022] GET /identity/v3/projects/b0de385b20724662bfc182dd6a4c2641 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:46.604375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b73d3-da58-4540-9e3d-9a708695821a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:46.607561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac855-b31a-43ae-bb07-3fe5405fdfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:46.609480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac855-b31a-43ae-bb07-3fe5405fdfa5 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.610182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac855-b31a-43ae-bb07-3fe5405fdfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.611029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac855-b31a-43ae-bb07-3fe5405fdfa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.650082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:46.659318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:46.694935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cac855-b31a-43ae-bb07-3fe5405fdfa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:46.696732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cac855-b31a-43ae-bb07-3fe5405fdfa5 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:46.734623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b73d3-da58-4540-9e3d-9a708695821a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:46.773637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72da3d3-a9ac-4de3-aba0-80db3c646444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:46.774262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72da3d3-a9ac-4de3-aba0-80db3c646444 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.774539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72da3d3-a9ac-4de3-aba0-80db3c646444 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.774840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72da3d3-a9ac-4de3-aba0-80db3c646444 None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.775941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72da3d3-a9ac-4de3-aba0-80db3c646444 None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:46.777381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72da3d3-a9ac-4de3-aba0-80db3c646444 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:46.778993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 223/436] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:46 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:46.780146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4442e-0e1a-430e-8bcc-c16ec69d480a None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.780424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4442e-0e1a-430e-8bcc-c16ec69d480a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.780691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4442e-0e1a-430e-8bcc-c16ec69d480a None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.782091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 224/437] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:46.784073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4442e-0e1a-430e-8bcc-c16ec69d480a None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:46.806654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 214/438] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:46.807374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac855-b31a-43ae-bb07-3fe5405fdfa5 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:46.869197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:46.890600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4442e-0e1a-430e-8bcc-c16ec69d480a None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:46.900609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:46.911521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac855-b31a-43ae-bb07-3fe5405fdfa5 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:46.926261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791fafc-d568-4560-8f4b-51b667b4c949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:46.926932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791fafc-d568-4560-8f4b-51b667b4c949 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.927212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791fafc-d568-4560-8f4b-51b667b4c949 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.927483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791fafc-d568-4560-8f4b-51b667b4c949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.940663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791fafc-d568-4560-8f4b-51b667b4c949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-5791fafc-d568-4560-8f4b-51b667b4c949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:46.945486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:46.946402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:46.947275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 225/439] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:46.949900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e9144-d0bf-4d71-9005-d8d8fb5d6003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:46.950509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e9144-d0bf-4d71-9005-d8d8fb5d6003 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.950890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e9144-d0bf-4d71-9005-d8d8fb5d6003 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.951189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e9144-d0bf-4d71-9005-d8d8fb5d6003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.951905 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e9144-d0bf-4d71-9005-d8d8fb5d6003 None admin] RBAC: Adding query filter params (group.id=71a4ed5e1b0647e99575dacf405dac1c, role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=b0de385b20724662bfc182dd6a4c2641) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:46.952214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e9144-d0bf-4d71-9005-d8d8fb5d6003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:46.953004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33780f9-9b4d-4fb3-9033-cc9c75a80f77 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:46.953295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33780f9-9b4d-4fb3-9033-cc9c75a80f77 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:46.953575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33780f9-9b4d-4fb3-9033-cc9c75a80f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:46.953674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e9144-d0bf-4d71-9005-d8d8fb5d6003 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:46.969546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 215/440] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:46 2022] GET /identity/v3/role_assignments?group.id=71a4ed5e1b0647e99575dacf405dac1c&scope.project.id=b0de385b20724662bfc182dd6a4c2641&role.id=40201003f53c4077b8e412e7d4450cab => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:46.969546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e9144-d0bf-4d71-9005-d8d8fb5d6003 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:46.984012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f33780f9-9b4d-4fb3-9033-cc9c75a80f77 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:46.985839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f33780f9-9b4d-4fb3-9033-cc9c75a80f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:47.076621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 226/441] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:47.077965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33780f9-9b4d-4fb3-9033-cc9c75a80f77 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:47.095992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e9144-d0bf-4d71-9005-d8d8fb5d6003 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:47.133713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:47.144956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b8dc8-27a6-4300-9c2a-63db5cdd2793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:47.145147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b8dc8-27a6-4300-9c2a-63db5cdd2793 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:47.145489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b8dc8-27a6-4300-9c2a-63db5cdd2793 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:47.145754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b8dc8-27a6-4300-9c2a-63db5cdd2793 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:47.147855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b8dc8-27a6-4300-9c2a-63db5cdd2793 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:47.148442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b8dc8-27a6-4300-9c2a-63db5cdd2793 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:47.150240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 216/442] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:46 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:47.155618 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b8dc8-27a6-4300-9c2a-63db5cdd2793 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:47.218853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:47.225710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33780f9-9b4d-4fb3-9033-cc9c75a80f77 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:47.267388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6155202-5e82-48bc-94a8-ccda35884226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:47.268023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6155202-5e82-48bc-94a8-ccda35884226 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:47.268304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6155202-5e82-48bc-94a8-ccda35884226 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:47.268580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6155202-5e82-48bc-94a8-ccda35884226 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:47.269575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6155202-5e82-48bc-94a8-ccda35884226 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:47.269575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6155202-5e82-48bc-94a8-ccda35884226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:47.270975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6155202-5e82-48bc-94a8-ccda35884226 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:47.281263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 227/443] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:47.287642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6155202-5e82-48bc-94a8-ccda35884226 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:47.301372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b8dc8-27a6-4300-9c2a-63db5cdd2793 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:47.351357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b7a44-78b2-4bd5-838d-3dc18c7f5d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:47.352261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b7a44-78b2-4bd5-838d-3dc18c7f5d2a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:47.352681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b7a44-78b2-4bd5-838d-3dc18c7f5d2a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:47.353164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b7a44-78b2-4bd5-838d-3dc18c7f5d2a None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:47.354934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b7a44-78b2-4bd5-838d-3dc18c7f5d2a None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:47.356511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b7a44-78b2-4bd5-838d-3dc18c7f5d2a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:47.358167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 217/444] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:47 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:47.366701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b7a44-78b2-4bd5-838d-3dc18c7f5d2a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:47.420704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6155202-5e82-48bc-94a8-ccda35884226 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:47.442011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:47.458066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfd9a1-cb03-4612-85d7-8449183e5ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:47.458671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfd9a1-cb03-4612-85d7-8449183e5ba8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:47.458991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfd9a1-cb03-4612-85d7-8449183e5ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:47.459265 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfd9a1-cb03-4612-85d7-8449183e5ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:47.486097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b7a44-78b2-4bd5-838d-3dc18c7f5d2a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:47.487846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:47.524912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f858662-2ed1-40ea-aed9-6ba08a95973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:47.525517 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858662-2ed1-40ea-aed9-6ba08a95973d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:47.525800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858662-2ed1-40ea-aed9-6ba08a95973d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:47.526072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858662-2ed1-40ea-aed9-6ba08a95973d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:47.526813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f858662-2ed1-40ea-aed9-6ba08a95973d None admin] RBAC: Adding query filter params (group.id=71a4ed5e1b0647e99575dacf405dac1c, role.id=2d6cbe50524e4807bb6ab829cef3525c, scope.project.id=f06373c3edbc40b1880f456b42cc666a) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:47.527123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f858662-2ed1-40ea-aed9-6ba08a95973d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:47.528568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f858662-2ed1-40ea-aed9-6ba08a95973d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:47.529441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfd9a1-cb03-4612-85d7-8449183e5ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:47.530906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfd9a1-cb03-4612-85d7-8449183e5ba8 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:47.535754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 218/445] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:47 2022] GET /identity/v3/role_assignments?group.id=71a4ed5e1b0647e99575dacf405dac1c&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=2d6cbe50524e4807bb6ab829cef3525c => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:47.536480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f858662-2ed1-40ea-aed9-6ba08a95973d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:47.657826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f858662-2ed1-40ea-aed9-6ba08a95973d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:47.670344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 228/446] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:47.671731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfd9a1-cb03-4612-85d7-8449183e5ba8 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:47.695371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:47.704373 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86ae63-9546-43bf-ad66-aff6e3c93616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:47.705398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86ae63-9546-43bf-ad66-aff6e3c93616 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:47.705398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86ae63-9546-43bf-ad66-aff6e3c93616 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:47.705632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86ae63-9546-43bf-ad66-aff6e3c93616 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:47.720613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86ae63-9546-43bf-ad66-aff6e3c93616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-4a86ae63-9546-43bf-ad66-aff6e3c93616 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:47.725877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:47.726964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:47.731540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 219/447] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:32:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:47.732766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86ae63-9546-43bf-ad66-aff6e3c93616 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:47.749314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:47.808479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfd9a1-cb03-4612-85d7-8449183e5ba8 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:47.849117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5e825-cea7-414e-bad9-de9b31ca7b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:47.849318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5e825-cea7-414e-bad9-de9b31ca7b61 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:47.849546 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5e825-cea7-414e-bad9-de9b31ca7b61 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:47.849799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5e825-cea7-414e-bad9-de9b31ca7b61 None admin] PATH_INFO: `/v3/projects/f06373c3edbc40b1880f456b42cc666a` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:47.851087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5e825-cea7-414e-bad9-de9b31ca7b61 None admin] RBAC: Authorizing `identity:get_project(project_id=f06373c3edbc40b1880f456b42cc666a)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:47.852736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5e825-cea7-414e-bad9-de9b31ca7b61 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:47.854872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 229/448] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:47 2022] GET /identity/v3/projects/f06373c3edbc40b1880f456b42cc666a => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:47.860566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5e825-cea7-414e-bad9-de9b31ca7b61 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:47.866038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86ae63-9546-43bf-ad66-aff6e3c93616 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:47.909677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7110c5-ffa9-494b-bd86-52bdac4b528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:47.910276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7110c5-ffa9-494b-bd86-52bdac4b528d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:47.910554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7110c5-ffa9-494b-bd86-52bdac4b528d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:47.910883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7110c5-ffa9-494b-bd86-52bdac4b528d None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:47.911583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7110c5-ffa9-494b-bd86-52bdac4b528d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:47.911883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7110c5-ffa9-494b-bd86-52bdac4b528d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:47.913240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7110c5-ffa9-494b-bd86-52bdac4b528d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:47.921695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 220/449] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:47.927108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7110c5-ffa9-494b-bd86-52bdac4b528d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:47.978541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:47.990163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5e825-cea7-414e-bad9-de9b31ca7b61 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:48.018670 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:48.026684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812e69c-d548-465e-a99b-c41b560130cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:48.027338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812e69c-d548-465e-a99b-c41b560130cb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:48.027621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812e69c-d548-465e-a99b-c41b560130cb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:48.027893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812e69c-d548-465e-a99b-c41b560130cb None admin] PATH_INFO: `/v3/groups/71a4ed5e1b0647e99575dacf405dac1c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:48.028997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812e69c-d548-465e-a99b-c41b560130cb None admin] RBAC: Authorizing `identity:get_group(group_id=71a4ed5e1b0647e99575dacf405dac1c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:48.030432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812e69c-d548-465e-a99b-c41b560130cb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:48.031138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7110c5-ffa9-494b-bd86-52bdac4b528d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:48.032976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 230/450] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:47 2022] GET /identity/v3/groups/71a4ed5e1b0647e99575dacf405dac1c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:48.037837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812e69c-d548-465e-a99b-c41b560130cb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:48.066121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f144c4-55da-4125-ab20-bc8d3eddf7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:48.066759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f144c4-55da-4125-ab20-bc8d3eddf7cd None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:48.067067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f144c4-55da-4125-ab20-bc8d3eddf7cd None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:48.067336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f144c4-55da-4125-ab20-bc8d3eddf7cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:48.141275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812e69c-d548-465e-a99b-c41b560130cb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:48.142100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f144c4-55da-4125-ab20-bc8d3eddf7cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:48.143768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f144c4-55da-4125-ab20-bc8d3eddf7cd None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:48.175759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575f116-4aa7-4e25-9026-08cb21660ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:48.176359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575f116-4aa7-4e25-9026-08cb21660ae1 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:48.176635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575f116-4aa7-4e25-9026-08cb21660ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:48.176908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575f116-4aa7-4e25-9026-08cb21660ae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:48.177630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575f116-4aa7-4e25-9026-08cb21660ae1 None admin] RBAC: Adding query filter params (group.id=71a4ed5e1b0647e99575dacf405dac1c, role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=f06373c3edbc40b1880f456b42cc666a) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:48.177932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575f116-4aa7-4e25-9026-08cb21660ae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:48.179425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575f116-4aa7-4e25-9026-08cb21660ae1 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:48.185678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 231/451] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:48 2022] GET /identity/v3/role_assignments?group.id=71a4ed5e1b0647e99575dacf405dac1c&scope.project.id=f06373c3edbc40b1880f456b42cc666a&role.id=40201003f53c4077b8e412e7d4450cab => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:48.198672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:48.255749 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 221/452] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:48.262069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575f116-4aa7-4e25-9026-08cb21660ae1 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:48.329469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:48.374666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575f116-4aa7-4e25-9026-08cb21660ae1 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:48.414652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e44ac-759e-477b-8a9f-3277b4d12ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:48.415396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e44ac-759e-477b-8a9f-3277b4d12ccd None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:48.415672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e44ac-759e-477b-8a9f-3277b4d12ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:48.415938 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e44ac-759e-477b-8a9f-3277b4d12ccd None admin] PATH_INFO: `/v3/projects/366850b748b7483f9a23090a350c7e5e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:48.417059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e44ac-759e-477b-8a9f-3277b4d12ccd None admin] RBAC: Authorizing `identity:get_project(project_id=366850b748b7483f9a23090a350c7e5e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:48.418495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e44ac-759e-477b-8a9f-3277b4d12ccd None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:48.420145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 232/453] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:32:48 2022] GET /identity/v3/projects/366850b748b7483f9a23090a350c7e5e => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:48.426265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f144c4-55da-4125-ab20-bc8d3eddf7cd None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:48.529520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f144c4-55da-4125-ab20-bc8d3eddf7cd None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:48.565363 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a7ded-3174-4ccd-afcf-5786602d7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:48.565991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a7ded-3174-4ccd-afcf-5786602d7db3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:48.566268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a7ded-3174-4ccd-afcf-5786602d7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:48.566536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a7ded-3174-4ccd-afcf-5786602d7db3 None admin] PATH_INFO: `/v3/groups/44fbdec0ade74011b3c50d59822fb448` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:48.567663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a7ded-3174-4ccd-afcf-5786602d7db3 None admin] RBAC: Authorizing `identity:get_group(group_id=44fbdec0ade74011b3c50d59822fb448)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:48.569101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a7ded-3174-4ccd-afcf-5786602d7db3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:48.570668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 222/454] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 11:32:48 2022] GET /identity/v3/groups/44fbdec0ade74011b3c50d59822fb448 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:48.576637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e44ac-759e-477b-8a9f-3277b4d12ccd None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:48.678061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e44ac-759e-477b-8a9f-3277b4d12ccd None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:48.703811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:48.712406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a39818-42f9-4f1e-8cf6-e730a810549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:48.713062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39818-42f9-4f1e-8cf6-e730a810549b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:48.713346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39818-42f9-4f1e-8cf6-e730a810549b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:48.713618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39818-42f9-4f1e-8cf6-e730a810549b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:48.714394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a39818-42f9-4f1e-8cf6-e730a810549b None admin] RBAC: Adding query filter params (group.id=44fbdec0ade74011b3c50d59822fb448, role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=366850b748b7483f9a23090a350c7e5e) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:48.714703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a39818-42f9-4f1e-8cf6-e730a810549b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:48.716231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a39818-42f9-4f1e-8cf6-e730a810549b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:48.723211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 233/455] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 11:32:48 2022] GET /identity/v3/role_assignments?group.id=44fbdec0ade74011b3c50d59822fb448&scope.project.id=366850b748b7483f9a23090a350c7e5e&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:50.995120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd94d4-c190-4b56-878c-0acb750e5e35 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:50.995615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd94d4-c190-4b56-878c-0acb750e5e35 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:50.995689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd94d4-c190-4b56-878c-0acb750e5e35 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:50.997372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 223/456] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:51.003837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95183c-ef99-4d3f-8168-1caa1ce30ee4 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:51.004293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95183c-ef99-4d3f-8168-1caa1ce30ee4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:51.004392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95183c-ef99-4d3f-8168-1caa1ce30ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:51.030906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9e95183c-ef99-4d3f-8168-1caa1ce30ee4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:51.032144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9e95183c-ef99-4d3f-8168-1caa1ce30ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:51.131676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 234/457] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:51.305309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007d52-8b8c-4d74-8a57-b41941c3420b None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:51.305309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007d52-8b8c-4d74-8a57-b41941c3420b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:51.305309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007d52-8b8c-4d74-8a57-b41941c3420b None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:51.305855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 224/458] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:51.311282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ea851-b708-4c3f-97c0-11a0dee453ea None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:51.311835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ea851-b708-4c3f-97c0-11a0dee453ea None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:51.312334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ea851-b708-4c3f-97c0-11a0dee453ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:51.332024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-037ea851-b708-4c3f-97c0-11a0dee453ea None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:51.333565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-037ea851-b708-4c3f-97c0-11a0dee453ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:51.413093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 235/459] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:51.417711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18f04d-865c-4718-946f-c658f9a3c84b None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:51.418246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18f04d-865c-4718-946f-c658f9a3c84b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:51.418737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18f04d-865c-4718-946f-c658f9a3c84b None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:51.420300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 225/460] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:51.426583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08cdea-d0b8-4db3-ab07-9590910412c4 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:51.427136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08cdea-d0b8-4db3-ab07-9590910412c4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:51.427633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08cdea-d0b8-4db3-ab07-9590910412c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:51.451734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ab08cdea-d0b8-4db3-ab07-9590910412c4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:51.453261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ab08cdea-d0b8-4db3-ab07-9590910412c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:51.519171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:51.541006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 236/461] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:51.567007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18f04d-865c-4718-946f-c658f9a3c84b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:51.589844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:51.695483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18f04d-865c-4718-946f-c658f9a3c84b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:51.741864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a32e2-b287-4dd2-a99b-c0a50dd3a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:51.742557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a32e2-b287-4dd2-a99b-c0a50dd3a74a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:51.742949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a32e2-b287-4dd2-a99b-c0a50dd3a74a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:51.743219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a32e2-b287-4dd2-a99b-c0a50dd3a74a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:51.758205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a32e2-b287-4dd2-a99b-c0a50dd3a74a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:51.760061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a32e2-b287-4dd2-a99b-c0a50dd3a74a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-622a32e2-b287-4dd2-a99b-c0a50dd3a74a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:51.775527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:51.776518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:51.777357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:51.777357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:51.777357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:51.777357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 226/462] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:51.785325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08cdea-d0b8-4db3-ab07-9590910412c4 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:51.804478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a32e2-b287-4dd2-a99b-c0a50dd3a74a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:51.902408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08cdea-d0b8-4db3-ab07-9590910412c4 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:51.941696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:51.948535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e4c66-d584-40ac-acc2-a6e493b1872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:51.949168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e4c66-d584-40ac-acc2-a6e493b1872c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:51.949453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e4c66-d584-40ac-acc2-a6e493b1872c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:51.949729 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e4c66-d584-40ac-acc2-a6e493b1872c None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:51.950500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e4c66-d584-40ac-acc2-a6e493b1872c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:51.950830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e4c66-d584-40ac-acc2-a6e493b1872c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:51.952218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e4c66-d584-40ac-acc2-a6e493b1872c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:51.967579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a32e2-b287-4dd2-a99b-c0a50dd3a74a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:51.973176 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 237/463] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:51.974227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e4c66-d584-40ac-acc2-a6e493b1872c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:52.019036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071f411-757c-4ad7-b42a-d59d498edf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:52.019820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071f411-757c-4ad7-b42a-d59d498edf65 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.020322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071f411-757c-4ad7-b42a-d59d498edf65 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.020790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071f411-757c-4ad7-b42a-d59d498edf65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.025775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:52.038625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071f411-757c-4ad7-b42a-d59d498edf65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:52.040933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071f411-757c-4ad7-b42a-d59d498edf65 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-6071f411-757c-4ad7-b42a-d59d498edf65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:52.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:52.062895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:52.063759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:52.063759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:52.063759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:52.066608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 227/464] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:52.067691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071f411-757c-4ad7-b42a-d59d498edf65 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:52.094132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e4c66-d584-40ac-acc2-a6e493b1872c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:52.138320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5633-4901-46b7-9ac0-0ceba3c34c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:52.139039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5633-4901-46b7-9ac0-0ceba3c34c8b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.139320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5633-4901-46b7-9ac0-0ceba3c34c8b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.139592 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5633-4901-46b7-9ac0-0ceba3c34c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.151268 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e5633-4901-46b7-9ac0-0ceba3c34c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:52.152317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e5633-4901-46b7-9ac0-0ceba3c34c8b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-7d5e5633-4901-46b7-9ac0-0ceba3c34c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:52.168009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:52.168914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:52.169777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:52.169777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:52.169777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:52.169777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 238/465] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:52.169993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5633-4901-46b7-9ac0-0ceba3c34c8b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:52.192127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071f411-757c-4ad7-b42a-d59d498edf65 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:52.222186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:52.236590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe809266-3e84-4535-8ce4-397da779fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:52.237204 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809266-3e84-4535-8ce4-397da779fdfc None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.237561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809266-3e84-4535-8ce4-397da779fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.237758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809266-3e84-4535-8ce4-397da779fdfc None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.238406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe809266-3e84-4535-8ce4-397da779fdfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:52.239898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe809266-3e84-4535-8ce4-397da779fdfc None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:52.263763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 228/466] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:52 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:52.265159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc182e1-6691-4bd0-8bad-69a3ecb894d7 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.265669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc182e1-6691-4bd0-8bad-69a3ecb894d7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.265775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc182e1-6691-4bd0-8bad-69a3ecb894d7 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.274839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 229/467] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:52.274839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc182e1-6691-4bd0-8bad-69a3ecb894d7 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:52.284358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:52.293730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5633-4901-46b7-9ac0-0ceba3c34c8b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:52.334243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe1e06-e1bb-45d5-8f64-9b90a925de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:52.334937 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe1e06-e1bb-45d5-8f64-9b90a925de1d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.335219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe1e06-e1bb-45d5-8f64-9b90a925de1d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.335492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe1e06-e1bb-45d5-8f64-9b90a925de1d None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.336152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe1e06-e1bb-45d5-8f64-9b90a925de1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:52.336455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe1e06-e1bb-45d5-8f64-9b90a925de1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:52.337867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe1e06-e1bb-45d5-8f64-9b90a925de1d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:52.356117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 239/468] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:52.357814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c4d7-366b-40e8-a690-8d513382ba90 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.358243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c4d7-366b-40e8-a690-8d513382ba90 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.358526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c4d7-366b-40e8-a690-8d513382ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.379539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-83e7c4d7-366b-40e8-a690-8d513382ba90 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:52.381024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-83e7c4d7-366b-40e8-a690-8d513382ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:52.444143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc182e1-6691-4bd0-8bad-69a3ecb894d7 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:52.482389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 240/469] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:52.483652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c4d7-366b-40e8-a690-8d513382ba90 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:52.490558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702c1a-7ead-4d11-a24e-424ed4122feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:52.491238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702c1a-7ead-4d11-a24e-424ed4122feb None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.491518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702c1a-7ead-4d11-a24e-424ed4122feb None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.491788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03702c1a-7ead-4d11-a24e-424ed4122feb None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.492438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03702c1a-7ead-4d11-a24e-424ed4122feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:52.492739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03702c1a-7ead-4d11-a24e-424ed4122feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:52.494115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03702c1a-7ead-4d11-a24e-424ed4122feb None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:52.507387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 230/470] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:52.513176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702c1a-7ead-4d11-a24e-424ed4122feb None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:52.587714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:52.607164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:52.620530 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c4d7-366b-40e8-a690-8d513382ba90 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:52.648830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03702c1a-7ead-4d11-a24e-424ed4122feb None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:52.690523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcfdbe-4f1f-4dc3-9195-c60d80222151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:52.691642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcfdbe-4f1f-4dc3-9195-c60d80222151 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.691935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcfdbe-4f1f-4dc3-9195-c60d80222151 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.692216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcfdbe-4f1f-4dc3-9195-c60d80222151 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.693018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcfdbe-4f1f-4dc3-9195-c60d80222151 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:52.694653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcfdbe-4f1f-4dc3-9195-c60d80222151 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:52.720861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d049-d543-41d4-8a10-c84de35b586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:52.721489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d049-d543-41d4-8a10-c84de35b586f None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.721770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d049-d543-41d4-8a10-c84de35b586f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.722045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d049-d543-41d4-8a10-c84de35b586f None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.724847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d049-d543-41d4-8a10-c84de35b586f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:52.726320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d049-d543-41d4-8a10-c84de35b586f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:52.726934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 231/471] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:52 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:52.751489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bc097-4a89-408e-984f-2adec7afc06d None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.751489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bc097-4a89-408e-984f-2adec7afc06d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.751906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bc097-4a89-408e-984f-2adec7afc06d None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.754053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 232/472] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:32:52.754643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 241/473] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:52 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:52.784823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167efe-3467-4a30-af5d-e6e69cc1585a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:52.785137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167efe-3467-4a30-af5d-e6e69cc1585a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:52.785384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167efe-3467-4a30-af5d-e6e69cc1585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:52.820128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3e167efe-3467-4a30-af5d-e6e69cc1585a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:52.821698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3e167efe-3467-4a30-af5d-e6e69cc1585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:52.826199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d049-d543-41d4-8a10-c84de35b586f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:52.910201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 233/474] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:53.001859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d049-d543-41d4-8a10-c84de35b586f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:53.039892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f3a26-7fa4-46a3-8395-56d05516c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:53.041253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f3a26-7fa4-46a3-8395-56d05516c68d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:53.041536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f3a26-7fa4-46a3-8395-56d05516c68d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:53.041805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f3a26-7fa4-46a3-8395-56d05516c68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:53.053384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:53.056272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f3a26-7fa4-46a3-8395-56d05516c68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:53.058080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f3a26-7fa4-46a3-8395-56d05516c68d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-546f3a26-7fa4-46a3-8395-56d05516c68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:53.074271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:53.075295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:53.076125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:53.076125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:53.076125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:53.076574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 242/475] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:53.084627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167efe-3467-4a30-af5d-e6e69cc1585a None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:53.116138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:53.200676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167efe-3467-4a30-af5d-e6e69cc1585a None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:53.245868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0272-a42a-4ec3-9d22-a93c8ff2d5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:53.246068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f3a26-7fa4-46a3-8395-56d05516c68d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:53.246480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0272-a42a-4ec3-9d22-a93c8ff2d5ca None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:53.246759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0272-a42a-4ec3-9d22-a93c8ff2d5ca None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:53.247062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0272-a42a-4ec3-9d22-a93c8ff2d5ca None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:53.247717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0272-a42a-4ec3-9d22-a93c8ff2d5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:53.248019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0272-a42a-4ec3-9d22-a93c8ff2d5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:53.249510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0272-a42a-4ec3-9d22-a93c8ff2d5ca None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:53.272337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 234/476] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:53.276012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0272-a42a-4ec3-9d22-a93c8ff2d5ca None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:53.430212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f3a26-7fa4-46a3-8395-56d05516c68d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:53.432012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:53.460982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0272-a42a-4ec3-9d22-a93c8ff2d5ca None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:53.503422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:53.504044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:53.504323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:53.504597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:53.505283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:53.506669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:53.521228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.sql.core [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 11:32:53.521228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 11:32:53.521228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [parameters: {'id': 'c27e8fadf2654cea8245fce62486a8d9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 11:32:53.521228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88086) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 11:32:53.534878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2dba-3cc3-4309-bf64-8538746bc85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:53.535455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2dba-3cc3-4309-bf64-8538746bc85a None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:53.535741 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2dba-3cc3-4309-bf64-8538746bc85a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:53.536016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2dba-3cc3-4309-bf64-8538746bc85a None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:53.536669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2dba-3cc3-4309-bf64-8538746bc85a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:53.538166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2dba-3cc3-4309-bf64-8538746bc85a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application result.read() Aug 24 11:32:53.554966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:32:53.555881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application yield resource Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise self.value Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application session.commit() Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 11:32:53.556768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self.session.flush() Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application compat.raise_( Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 11:32:53.557599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:32:53.558469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application result.read() Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:32:53.559315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [parameters: {'id': 'c27e8fadf2654cea8245fce62486a8d9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:53.560081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 11:32:53.560877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:53.561710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 243/477] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 11:32:53 2022] POST /identity/v3/roles => generated 144 bytes in 316 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:53.580383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:53.588705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 235/478] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:53 2022] POST /identity/v3/users => generated 249 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:32:53.667260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:53.738733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628973f4-cb91-47ea-bef2-cd6c39bf57ae None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:53.783211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63a25d-cf3b-4964-bedf-3bd063673628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:53.783846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a25d-cf3b-4964-bedf-3bd063673628 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:53.784120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a25d-cf3b-4964-bedf-3bd063673628 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:53.784383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a25d-cf3b-4964-bedf-3bd063673628 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:53.794940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63a25d-cf3b-4964-bedf-3bd063673628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-fb63a25d-cf3b-4964-bedf-3bd063673628 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:53.800016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:53.801992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:53.803920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 244/479] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:32:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:53.807103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2dba-3cc3-4309-bf64-8538746bc85a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:53.927218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2dba-3cc3-4309-bf64-8538746bc85a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:53.966830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6729d-7f1f-4864-b154-829e91614968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:53.967489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6729d-7f1f-4864-b154-829e91614968 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:53.967765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6729d-7f1f-4864-b154-829e91614968 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:53.968081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6729d-7f1f-4864-b154-829e91614968 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:53.968747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6729d-7f1f-4864-b154-829e91614968 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:53.969048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6729d-7f1f-4864-b154-829e91614968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:53.970605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6729d-7f1f-4864-b154-829e91614968 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:53.982904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 236/480] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:54.683779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f7a4a-afea-4ee9-909c-b81ea3b5ff39 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:54.684319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f7a4a-afea-4ee9-909c-b81ea3b5ff39 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:54.684319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f7a4a-afea-4ee9-909c-b81ea3b5ff39 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:54.685934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 245/481] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:54.691488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cb307-75be-4317-96d5-4ad43f562679 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:54.691940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cb307-75be-4317-96d5-4ad43f562679 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:54.691940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cb307-75be-4317-96d5-4ad43f562679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:54.701752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:54.720432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-631cb307-75be-4317-96d5-4ad43f562679 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:54.721708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-631cb307-75be-4317-96d5-4ad43f562679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:54.813839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 237/482] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:55.091461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646079-5a6f-40d6-96b5-ffa1dbe66df5 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:55.091813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646079-5a6f-40d6-96b5-ffa1dbe66df5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:55.092017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646079-5a6f-40d6-96b5-ffa1dbe66df5 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:55.093620 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 246/483] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:55.099031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6979f-393d-4971-b48e-460fcc0ecc18 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:55.099315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6979f-393d-4971-b48e-460fcc0ecc18 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:55.099590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6979f-393d-4971-b48e-460fcc0ecc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:55.123764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-aba6979f-393d-4971-b48e-460fcc0ecc18 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:55.124984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-aba6979f-393d-4971-b48e-460fcc0ecc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:55.221960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 238/484] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:55.243806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a743f8-98a3-48a0-a22a-09a2beb75be3 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:55.244498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a743f8-98a3-48a0-a22a-09a2beb75be3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:55.244969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a743f8-98a3-48a0-a22a-09a2beb75be3 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:55.250374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 247/485] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:55.252849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492a8f2-df03-4d7d-8865-9007f4591dac None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:55.253142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492a8f2-df03-4d7d-8865-9007f4591dac None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:55.253414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492a8f2-df03-4d7d-8865-9007f4591dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:55.279978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b492a8f2-df03-4d7d-8865-9007f4591dac None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:55.280611 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a743f8-98a3-48a0-a22a-09a2beb75be3 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:55.281187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b492a8f2-df03-4d7d-8865-9007f4591dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:55.343145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:55.353907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 239/486] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:55.471137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a743f8-98a3-48a0-a22a-09a2beb75be3 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:55.497257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:55.513758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492a8f2-df03-4d7d-8865-9007f4591dac None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:55.527336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10c6f0-5dba-47b9-b331-7c8d1d70151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:55.527973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10c6f0-5dba-47b9-b331-7c8d1d70151c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:55.528251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10c6f0-5dba-47b9-b331-7c8d1d70151c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:55.528518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10c6f0-5dba-47b9-b331-7c8d1d70151c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:55.549239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10c6f0-5dba-47b9-b331-7c8d1d70151c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-6c10c6f0-5dba-47b9-b331-7c8d1d70151c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:55.554490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:55.555544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:55.556340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 248/487] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:32:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:55.561186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10c6f0-5dba-47b9-b331-7c8d1d70151c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:55.708986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492a8f2-df03-4d7d-8865-9007f4591dac None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:55.715167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10c6f0-5dba-47b9-b331-7c8d1d70151c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:55.752568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b49c8c-8ef2-43cf-9b9e-019847b674eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:55.753507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b49c8c-8ef2-43cf-9b9e-019847b674eb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:55.753983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b49c8c-8ef2-43cf-9b9e-019847b674eb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:55.754445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b49c8c-8ef2-43cf-9b9e-019847b674eb None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:55.755563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b49c8c-8ef2-43cf-9b9e-019847b674eb None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:55.756093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b49c8c-8ef2-43cf-9b9e-019847b674eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:55.757561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b49c8c-8ef2-43cf-9b9e-019847b674eb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:55.767338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 249/488] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:32:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:32:55.768284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b49c8c-8ef2-43cf-9b9e-019847b674eb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:55.775887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa105ca-37d1-427a-bf49-df149e8d3eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:55.776854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa105ca-37d1-427a-bf49-df149e8d3eeb None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:55.777348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa105ca-37d1-427a-bf49-df149e8d3eeb None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:55.777789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa105ca-37d1-427a-bf49-df149e8d3eeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:55.790311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa105ca-37d1-427a-bf49-df149e8d3eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-6fa105ca-37d1-427a-bf49-df149e8d3eeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:55.795539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:55.796435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:32:55.797244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:55.800417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 240/489] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:32:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:32:55.801407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa105ca-37d1-427a-bf49-df149e8d3eeb None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:55.819762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:55.871775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:55.907574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b49c8c-8ef2-43cf-9b9e-019847b674eb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:55.935372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa105ca-37d1-427a-bf49-df149e8d3eeb None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:55.945036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e40c3-4d04-4fca-978c-0f48831dfb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:55.945743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e40c3-4d04-4fca-978c-0f48831dfb46 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:55.946023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e40c3-4d04-4fca-978c-0f48831dfb46 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:55.946395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e40c3-4d04-4fca-978c-0f48831dfb46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:55.959571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e40c3-4d04-4fca-978c-0f48831dfb46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-8e0e40c3-4d04-4fca-978c-0f48831dfb46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:55.965127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:55.966030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:55.967288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 250/490] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:32:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:55.968157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e40c3-4d04-4fca-978c-0f48831dfb46 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:55.988722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48304410-6dc9-4a1c-8ce6-a3d8146610d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:55.989512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48304410-6dc9-4a1c-8ce6-a3d8146610d1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:55.989860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48304410-6dc9-4a1c-8ce6-a3d8146610d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:55.990136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48304410-6dc9-4a1c-8ce6-a3d8146610d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.004172 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48304410-6dc9-4a1c-8ce6-a3d8146610d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.005903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48304410-6dc9-4a1c-8ce6-a3d8146610d1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-48304410-6dc9-4a1c-8ce6-a3d8146610d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:56.027032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:56.027988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:56.028837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:56.028837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:56.028837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:56.030913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 241/491] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:56.032604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48304410-6dc9-4a1c-8ce6-a3d8146610d1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:56.107276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:56.114647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e40c3-4d04-4fca-978c-0f48831dfb46 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:56.159555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c1210-3d4a-478f-b957-61e603cdd00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:56.160562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c1210-3d4a-478f-b957-61e603cdd00c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.161016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c1210-3d4a-478f-b957-61e603cdd00c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.161747 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c1210-3d4a-478f-b957-61e603cdd00c None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.162858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c1210-3d4a-478f-b957-61e603cdd00c None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:56.163301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c1210-3d4a-478f-b957-61e603cdd00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.165569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c1210-3d4a-478f-b957-61e603cdd00c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.167652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48304410-6dc9-4a1c-8ce6-a3d8146610d1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:56.170613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:56.176906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 251/492] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:32:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:56.178155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c1210-3d4a-478f-b957-61e603cdd00c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:56.214847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8750a6d-0328-40ba-a45e-5ad780f92a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:56.215628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8750a6d-0328-40ba-a45e-5ad780f92a99 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.216007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8750a6d-0328-40ba-a45e-5ad780f92a99 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.216492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8750a6d-0328-40ba-a45e-5ad780f92a99 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.217532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8750a6d-0328-40ba-a45e-5ad780f92a99 None admin] RBAC: Adding query filter params (name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:56.217921 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8750a6d-0328-40ba-a45e-5ad780f92a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.220338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8750a6d-0328-40ba-a45e-5ad780f92a99 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.234855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 242/493] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:32:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:56.237152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8750a6d-0328-40ba-a45e-5ad780f92a99 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:56.335281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c1210-3d4a-478f-b957-61e603cdd00c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:56.367074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8750a6d-0328-40ba-a45e-5ad780f92a99 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:56.374964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096650e8-4d1c-45b4-8c63-75fd69abc19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:56.375640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096650e8-4d1c-45b4-8c63-75fd69abc19f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.375917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096650e8-4d1c-45b4-8c63-75fd69abc19f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.376718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096650e8-4d1c-45b4-8c63-75fd69abc19f None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.377383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096650e8-4d1c-45b4-8c63-75fd69abc19f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:56.378082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096650e8-4d1c-45b4-8c63-75fd69abc19f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.379779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096650e8-4d1c-45b4-8c63-75fd69abc19f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.397245 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 252/494] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:56.398142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096650e8-4d1c-45b4-8c63-75fd69abc19f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:56.407322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a0156-c101-467f-9404-aecd8a1709ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:56.407994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a0156-c101-467f-9404-aecd8a1709ec None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.408308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a0156-c101-467f-9404-aecd8a1709ec None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.408582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a0156-c101-467f-9404-aecd8a1709ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.419774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a0156-c101-467f-9404-aecd8a1709ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.421227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a0156-c101-467f-9404-aecd8a1709ec None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.425796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-ef7a0156-c101-467f-9404-aecd8a1709ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:56.437708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:56.438704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:56.444997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:56.444997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:56.444997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:56.444997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 243/495] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:56.444997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c9969-5673-41e0-ad43-214b91df1bc6 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.444997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c9969-5673-41e0-ad43-214b91df1bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.444997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c9969-5673-41e0-ad43-214b91df1bc6 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.444997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 244/496] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:56.444997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c9969-5673-41e0-ad43-214b91df1bc6 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:56.467959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:56.519015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096650e8-4d1c-45b4-8c63-75fd69abc19f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:56.553862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30920-db8b-4531-9bf1-146e3c8096f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:56.554586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30920-db8b-4531-9bf1-146e3c8096f6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.554911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30920-db8b-4531-9bf1-146e3c8096f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.555182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30920-db8b-4531-9bf1-146e3c8096f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.558475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c9969-5673-41e0-ad43-214b91df1bc6 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:56.565480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30920-db8b-4531-9bf1-146e3c8096f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.567022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30920-db8b-4531-9bf1-146e3c8096f6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-d2b30920-db8b-4531-9bf1-146e3c8096f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:56.582633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:56.583596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:56.584468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:56.584468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:56.584468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:56.584468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 253/497] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:56.584679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30920-db8b-4531-9bf1-146e3c8096f6 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:56.597158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014a360-9715-4592-95a2-de0cb79cd95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:56.597713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014a360-9715-4592-95a2-de0cb79cd95f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.597985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014a360-9715-4592-95a2-de0cb79cd95f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.598250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014a360-9715-4592-95a2-de0cb79cd95f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.607344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014a360-9715-4592-95a2-de0cb79cd95f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.608354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014a360-9715-4592-95a2-de0cb79cd95f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-4014a360-9715-4592-95a2-de0cb79cd95f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:32:56.621198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:56.622211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:56.623116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 245/498] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 11:32:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:56.623750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677c5a5-dd95-490b-8674-26a5e15f8fa9 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.627083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677c5a5-dd95-490b-8674-26a5e15f8fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.627083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677c5a5-dd95-490b-8674-26a5e15f8fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.646647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-8677c5a5-dd95-490b-8674-26a5e15f8fa9 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:56.648792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8677c5a5-dd95-490b-8674-26a5e15f8fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:56.669256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:56.702740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30920-db8b-4531-9bf1-146e3c8096f6 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:56.719913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 246/499] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:56.721342 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f760313-fc89-4952-8e3c-90cb071ed915 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.721631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f760313-fc89-4952-8e3c-90cb071ed915 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.721903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f760313-fc89-4952-8e3c-90cb071ed915 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.726834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 247/500] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:32:56.726834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f760313-fc89-4952-8e3c-90cb071ed915 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:56.741321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:56.741673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc12c-3edc-4e82-b01f-b3c8f1de023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:56.742292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc12c-3edc-4e82-b01f-b3c8f1de023c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.742593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc12c-3edc-4e82-b01f-b3c8f1de023c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.742966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc12c-3edc-4e82-b01f-b3c8f1de023c None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.743715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc12c-3edc-4e82-b01f-b3c8f1de023c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:56.744140 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc12c-3edc-4e82-b01f-b3c8f1de023c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.745519 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc12c-3edc-4e82-b01f-b3c8f1de023c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.757863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 254/501] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:56.758756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc12c-3edc-4e82-b01f-b3c8f1de023c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:56.850833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f760313-fc89-4952-8e3c-90cb071ed915 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:56.867171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc12c-3edc-4e82-b01f-b3c8f1de023c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:56.889299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027a4fd-c9ec-4daf-94aa-96a0ec8a1b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:56.889913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027a4fd-c9ec-4daf-94aa-96a0ec8a1b63 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.890484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027a4fd-c9ec-4daf-94aa-96a0ec8a1b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.890484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027a4fd-c9ec-4daf-94aa-96a0ec8a1b63 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.891160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027a4fd-c9ec-4daf-94aa-96a0ec8a1b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:56.892003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027a4fd-c9ec-4daf-94aa-96a0ec8a1b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.893524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027a4fd-c9ec-4daf-94aa-96a0ec8a1b63 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.902453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:56.905909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 248/502] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:56.907653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe432f-8a3c-4c16-8249-e37a488a658f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.907926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe432f-8a3c-4c16-8249-e37a488a658f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.908137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe432f-8a3c-4c16-8249-e37a488a658f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.908703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d546a-5fd6-43c8-8fa9-ee9bbd13ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:56.909644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d546a-5fd6-43c8-8fa9-ee9bbd13ca14 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:56.909644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d546a-5fd6-43c8-8fa9-ee9bbd13ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:56.909906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d546a-5fd6-43c8-8fa9-ee9bbd13ca14 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:56.910657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d546a-5fd6-43c8-8fa9-ee9bbd13ca14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:56.910921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d546a-5fd6-43c8-8fa9-ee9bbd13ca14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:56.912328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d546a-5fd6-43c8-8fa9-ee9bbd13ca14 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:56.926716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6bfe432f-8a3c-4c16-8249-e37a488a658f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:32:56.932426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6bfe432f-8a3c-4c16-8249-e37a488a658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:32:56.956902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 255/503] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 11:32:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:56.957692 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d546a-5fd6-43c8-8fa9-ee9bbd13ca14 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.013926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:57.026911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 249/504] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:57.028100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe432f-8a3c-4c16-8249-e37a488a658f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.069889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d546a-5fd6-43c8-8fa9-ee9bbd13ca14 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.104848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f4946-5193-4866-a321-d25a36185395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.105398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4946-5193-4866-a321-d25a36185395 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.105681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4946-5193-4866-a321-d25a36185395 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.105947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4946-5193-4866-a321-d25a36185395 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:57.113579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f4946-5193-4866-a321-d25a36185395 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:57.115064 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f4946-5193-4866-a321-d25a36185395 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-e25f4946-5193-4866-a321-d25a36185395 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:32:57.128701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:57.129811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:57.130721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 256/505] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:57.131322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f4946-5193-4866-a321-d25a36185395 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.145572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe432f-8a3c-4c16-8249-e37a488a658f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.189526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:57.191694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8122d-7f97-4820-bbd3-5e118154ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.192332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8122d-7f97-4820-bbd3-5e118154ba2d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.192608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8122d-7f97-4820-bbd3-5e118154ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.192873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8122d-7f97-4820-bbd3-5e118154ba2d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:57.200429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8122d-7f97-4820-bbd3-5e118154ba2d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:57.201913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8122d-7f97-4820-bbd3-5e118154ba2d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-0dd8122d-7f97-4820-bbd3-5e118154ba2d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:32:57.214436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:57.215398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 250/506] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:57.216301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8122d-7f97-4820-bbd3-5e118154ba2d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.254435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f4946-5193-4866-a321-d25a36185395 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.283348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:57.293788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbceb0-4488-4786-ba0b-941350f39641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.294397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbceb0-4488-4786-ba0b-941350f39641 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.294675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbceb0-4488-4786-ba0b-941350f39641 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.294973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbceb0-4488-4786-ba0b-941350f39641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:57.333350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8122d-7f97-4820-bbd3-5e118154ba2d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.367289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbceb0-4488-4786-ba0b-941350f39641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:57.367543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0448fdb-d8be-4093-a7b9-1a9efbaf658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.368165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448fdb-d8be-4093-a7b9-1a9efbaf658e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.368439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448fdb-d8be-4093-a7b9-1a9efbaf658e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.368708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448fdb-d8be-4093-a7b9-1a9efbaf658e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:57.368808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbceb0-4488-4786-ba0b-941350f39641 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:57.378909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0448fdb-d8be-4093-a7b9-1a9efbaf658e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-e0448fdb-d8be-4093-a7b9-1a9efbaf658e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:32:57.383996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:57.385239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:57.386046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 251/507] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:57.386696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0448fdb-d8be-4093-a7b9-1a9efbaf658e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.425141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:57.477323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 257/508] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:57.478174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbceb0-4488-4786-ba0b-941350f39641 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.491227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0448fdb-d8be-4093-a7b9-1a9efbaf658e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.509080 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:57.527979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2360144-a99c-4705-8a2f-914632b423df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.528588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2360144-a99c-4705-8a2f-914632b423df None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.528867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2360144-a99c-4705-8a2f-914632b423df None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.529140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2360144-a99c-4705-8a2f-914632b423df None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:57.529866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2360144-a99c-4705-8a2f-914632b423df None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:57.530172 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2360144-a99c-4705-8a2f-914632b423df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:57.531634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2360144-a99c-4705-8a2f-914632b423df None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:57.569044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 252/509] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:57.569893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2360144-a99c-4705-8a2f-914632b423df None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.577651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbceb0-4488-4786-ba0b-941350f39641 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.614702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05288c01-4708-4788-ba79-d2f69e0e2dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.615337 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05288c01-4708-4788-ba79-d2f69e0e2dbf None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.615622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05288c01-4708-4788-ba79-d2f69e0e2dbf None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.615900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05288c01-4708-4788-ba79-d2f69e0e2dbf None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:57.616626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05288c01-4708-4788-ba79-d2f69e0e2dbf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:57.616934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05288c01-4708-4788-ba79-d2f69e0e2dbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:57.618435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05288c01-4708-4788-ba79-d2f69e0e2dbf None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:57.636388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 258/510] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:57.637199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05288c01-4708-4788-ba79-d2f69e0e2dbf None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.648568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:57.676691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2360144-a99c-4705-8a2f-914632b423df None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.712727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bd28f-01b9-4d6a-8349-f175e5e29e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.713376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd28f-01b9-4d6a-8349-f175e5e29e0f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.713658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd28f-01b9-4d6a-8349-f175e5e29e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.713924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd28f-01b9-4d6a-8349-f175e5e29e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:57.723853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bd28f-01b9-4d6a-8349-f175e5e29e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:57.725307 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bd28f-01b9-4d6a-8349-f175e5e29e0f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-d39bd28f-01b9-4d6a-8349-f175e5e29e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:57.739930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:57.741037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:57.741989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:57.741989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:57.741989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:57.742240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05288c01-4708-4788-ba79-d2f69e0e2dbf None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.742617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 253/511] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:57.742617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bd28f-01b9-4d6a-8349-f175e5e29e0f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.779545 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:57.788662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983aef6-3d90-4fe2-8e06-5ac042793dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.789275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983aef6-3d90-4fe2-8e06-5ac042793dfa None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.789558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983aef6-3d90-4fe2-8e06-5ac042793dfa None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.789833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983aef6-3d90-4fe2-8e06-5ac042793dfa None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:57.790503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983aef6-3d90-4fe2-8e06-5ac042793dfa None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:57.790840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983aef6-3d90-4fe2-8e06-5ac042793dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:57.792221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983aef6-3d90-4fe2-8e06-5ac042793dfa None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:57.800919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 259/512] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:57.801804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983aef6-3d90-4fe2-8e06-5ac042793dfa None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.858685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bd28f-01b9-4d6a-8349-f175e5e29e0f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.872167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:57.895521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67167783-54c9-4e95-8702-42c92c0ac420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.896247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67167783-54c9-4e95-8702-42c92c0ac420 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.896533 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67167783-54c9-4e95-8702-42c92c0ac420 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.896808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67167783-54c9-4e95-8702-42c92c0ac420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:57.906151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983aef6-3d90-4fe2-8e06-5ac042793dfa None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:57.907560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67167783-54c9-4e95-8702-42c92c0ac420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:57.908998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67167783-54c9-4e95-8702-42c92c0ac420 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-67167783-54c9-4e95-8702-42c92c0ac420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:57.923408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:57.924381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:57.925242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:57.925242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:57.925242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:57.925242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 254/513] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:57.925455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67167783-54c9-4e95-8702-42c92c0ac420 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:57.947474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8232334-5033-468b-8154-ba3db12ce437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:57.948118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8232334-5033-468b-8154-ba3db12ce437 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:57.948403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8232334-5033-468b-8154-ba3db12ce437 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:57.948679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8232334-5033-468b-8154-ba3db12ce437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.011793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:58.021603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8232334-5033-468b-8154-ba3db12ce437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.023312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8232334-5033-468b-8154-ba3db12ce437 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.030721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67167783-54c9-4e95-8702-42c92c0ac420 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.065574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700623-06a5-497b-a398-a697f2f6bb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.066181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700623-06a5-497b-a398-a697f2f6bb2b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.066462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700623-06a5-497b-a398-a697f2f6bb2b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.066733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700623-06a5-497b-a398-a697f2f6bb2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.092076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:58.124300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 260/514] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:58.125061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8232334-5033-468b-8154-ba3db12ce437 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.135703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58700623-06a5-497b-a398-a697f2f6bb2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.137156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58700623-06a5-497b-a398-a697f2f6bb2b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.221239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:58.228742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8232334-5033-468b-8154-ba3db12ce437 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.241930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 255/515] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:58.242788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700623-06a5-497b-a398-a697f2f6bb2b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.264625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f9df7-f6c9-4e4c-838f-1bc7f1bb0e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.265230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9df7-f6c9-4e4c-838f-1bc7f1bb0e79 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.265517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9df7-f6c9-4e4c-838f-1bc7f1bb0e79 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.265789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9df7-f6c9-4e4c-838f-1bc7f1bb0e79 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.267197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f9df7-f6c9-4e4c-838f-1bc7f1bb0e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:58.267510 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f9df7-f6c9-4e4c-838f-1bc7f1bb0e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.268896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f9df7-f6c9-4e4c-838f-1bc7f1bb0e79 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.280000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 261/516] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:58.280796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f9df7-f6c9-4e4c-838f-1bc7f1bb0e79 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.311968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:58.350561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700623-06a5-497b-a398-a697f2f6bb2b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.386011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f9df7-f6c9-4e4c-838f-1bc7f1bb0e79 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.388137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1727-8327-400a-bbb7-9940f219ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.388768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1727-8327-400a-bbb7-9940f219ef15 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.389051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1727-8327-400a-bbb7-9940f219ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.389321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1727-8327-400a-bbb7-9940f219ef15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.399610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1727-8327-400a-bbb7-9940f219ef15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.401508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1727-8327-400a-bbb7-9940f219ef15 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-b23c1727-8327-400a-bbb7-9940f219ef15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:58.416740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:58.417658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:58.418512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:58.418512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:58.418512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:58.421052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde046f5-ed23-4c40-a334-931adc3ac194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.421675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde046f5-ed23-4c40-a334-931adc3ac194 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.421946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde046f5-ed23-4c40-a334-931adc3ac194 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.422223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde046f5-ed23-4c40-a334-931adc3ac194 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.423200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 256/517] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:58.424037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde046f5-ed23-4c40-a334-931adc3ac194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:58.424142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1727-8327-400a-bbb7-9940f219ef15 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.424351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde046f5-ed23-4c40-a334-931adc3ac194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.425733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde046f5-ed23-4c40-a334-931adc3ac194 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.437920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 262/518] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:58.438834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde046f5-ed23-4c40-a334-931adc3ac194 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.457904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:58.529166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1727-8327-400a-bbb7-9940f219ef15 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.531907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:58.541902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde046f5-ed23-4c40-a334-931adc3ac194 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.565974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e6579-42ec-4845-b719-eb6dd5ffa275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.566607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e6579-42ec-4845-b719-eb6dd5ffa275 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.566921 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e6579-42ec-4845-b719-eb6dd5ffa275 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.567194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e6579-42ec-4845-b719-eb6dd5ffa275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.576709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9eb9c-4142-4847-8441-b6ca1b99ef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.577336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9eb9c-4142-4847-8441-b6ca1b99ef47 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.577584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e6579-42ec-4845-b719-eb6dd5ffa275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.577677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9eb9c-4142-4847-8441-b6ca1b99ef47 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.577879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9eb9c-4142-4847-8441-b6ca1b99ef47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.579849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e6579-42ec-4845-b719-eb6dd5ffa275 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.588978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9eb9c-4142-4847-8441-b6ca1b99ef47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.590417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9eb9c-4142-4847-8441-b6ca1b99ef47 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-747e6579-42ec-4845-b719-eb6dd5ffa275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:58.594139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:58.595558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:58.596404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:58.596404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:58.596404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:58.596404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 257/519] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:58.596613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e6579-42ec-4845-b719-eb6dd5ffa275 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-7da9eb9c-4142-4847-8441-b6ca1b99ef47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:32:58.607999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:58.608930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:32:58.609749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:32:58.609749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:32:58.609749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:58.609749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 263/520] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:58.614272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9eb9c-4142-4847-8441-b6ca1b99ef47 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.685106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:58.701810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e6579-42ec-4845-b719-eb6dd5ffa275 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.718320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9eb9c-4142-4847-8441-b6ca1b99ef47 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.740589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd32f3-cee5-4583-967e-c53d7fba9b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.741193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd32f3-cee5-4583-967e-c53d7fba9b6b None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.741477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd32f3-cee5-4583-967e-c53d7fba9b6b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.741746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd32f3-cee5-4583-967e-c53d7fba9b6b None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.742382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd32f3-cee5-4583-967e-c53d7fba9b6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.743841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd32f3-cee5-4583-967e-c53d7fba9b6b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.756203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ce494-f366-4181-84b5-2a8632a31d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.756923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ce494-f366-4181-84b5-2a8632a31d3a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.757236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ce494-f366-4181-84b5-2a8632a31d3a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.757574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ce494-f366-4181-84b5-2a8632a31d3a None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.758365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ce494-f366-4181-84b5-2a8632a31d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:58.758669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ce494-f366-4181-84b5-2a8632a31d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.760573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ce494-f366-4181-84b5-2a8632a31d3a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.765321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 258/521] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:32:58 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:32:58.766728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd32f3-cee5-4583-967e-c53d7fba9b6b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.789702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 264/522] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:58.789702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ce494-f366-4181-84b5-2a8632a31d3a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.790961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:58.895755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd32f3-cee5-4583-967e-c53d7fba9b6b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.917771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ce494-f366-4181-84b5-2a8632a31d3a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:58.942438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef79f2e-72ce-44bb-bec1-98cf853016d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.943175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef79f2e-72ce-44bb-bec1-98cf853016d3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.943269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef79f2e-72ce-44bb-bec1-98cf853016d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.943543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef79f2e-72ce-44bb-bec1-98cf853016d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.952094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef79f2e-72ce-44bb-bec1-98cf853016d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.954968 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef79f2e-72ce-44bb-bec1-98cf853016d3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.958343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:58.968914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea9af7-040d-494a-b3b0-6d1f760de519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:58.970337 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea9af7-040d-494a-b3b0-6d1f760de519 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:58.970616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea9af7-040d-494a-b3b0-6d1f760de519 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:58.971255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea9af7-040d-494a-b3b0-6d1f760de519 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:58.971604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea9af7-040d-494a-b3b0-6d1f760de519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:58.971962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea9af7-040d-494a-b3b0-6d1f760de519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-3ef79f2e-72ce-44bb-bec1-98cf853016d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:32:58.972280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:58.973286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:58.974433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:32:58.974433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:32:58.974433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:32:58.974433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:32:58.974433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:32:58.974433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:32:58.974433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:32:58.974433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:58.975200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea9af7-040d-494a-b3b0-6d1f760de519 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:58.975283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 259/523] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:58.975283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef79f2e-72ce-44bb-bec1-98cf853016d3 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:58.988331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 265/524] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:58.989188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea9af7-040d-494a-b3b0-6d1f760de519 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.060398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:59.087667 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef79f2e-72ce-44bb-bec1-98cf853016d3 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.105190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea9af7-040d-494a-b3b0-6d1f760de519 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.126247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91b124-92a9-4a1a-a1e7-4a06d4cf6e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.126904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91b124-92a9-4a1a-a1e7-4a06d4cf6e6e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.127272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91b124-92a9-4a1a-a1e7-4a06d4cf6e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.127456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91b124-92a9-4a1a-a1e7-4a06d4cf6e6e None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:59.128095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91b124-92a9-4a1a-a1e7-4a06d4cf6e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:59.128378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91b124-92a9-4a1a-a1e7-4a06d4cf6e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:59.129828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91b124-92a9-4a1a-a1e7-4a06d4cf6e6e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:59.143275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 260/525] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:59.144300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91b124-92a9-4a1a-a1e7-4a06d4cf6e6e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.152583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699dbf-85ed-4415-89e2-41bdeaaddeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.153223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699dbf-85ed-4415-89e2-41bdeaaddeac None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.153501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699dbf-85ed-4415-89e2-41bdeaaddeac None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.153774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699dbf-85ed-4415-89e2-41bdeaaddeac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:59.164406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20699dbf-85ed-4415-89e2-41bdeaaddeac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:59.165865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20699dbf-85ed-4415-89e2-41bdeaaddeac None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-20699dbf-85ed-4415-89e2-41bdeaaddeac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:32:59.178677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:59.184319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 266/526] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:32:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:59.185496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699dbf-85ed-4415-89e2-41bdeaaddeac None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.224148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:59.272939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91b124-92a9-4a1a-a1e7-4a06d4cf6e6e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.296889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699dbf-85ed-4415-89e2-41bdeaaddeac None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.313558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75128f3f-d999-4981-82fe-be50e8fa239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.314173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75128f3f-d999-4981-82fe-be50e8fa239d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.314460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75128f3f-d999-4981-82fe-be50e8fa239d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.314731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75128f3f-d999-4981-82fe-be50e8fa239d None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:59.315461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75128f3f-d999-4981-82fe-be50e8fa239d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:59.315766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75128f3f-d999-4981-82fe-be50e8fa239d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:59.317199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75128f3f-d999-4981-82fe-be50e8fa239d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:59.322124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:59.336046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96527632-381d-40c2-90bc-d6ba7a4bc13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.336682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96527632-381d-40c2-90bc-d6ba7a4bc13a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.336961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96527632-381d-40c2-90bc-d6ba7a4bc13a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.337235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96527632-381d-40c2-90bc-d6ba7a4bc13a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:59.337329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 261/527] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:32:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:59.339989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75128f3f-d999-4981-82fe-be50e8fa239d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.345443 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96527632-381d-40c2-90bc-d6ba7a4bc13a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:59.346947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96527632-381d-40c2-90bc-d6ba7a4bc13a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-96527632-381d-40c2-90bc-d6ba7a4bc13a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:32:59.359489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:59.360444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 267/528] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:59.361577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96527632-381d-40c2-90bc-d6ba7a4bc13a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.455980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75128f3f-d999-4981-82fe-be50e8fa239d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.478848 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:59.480482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96527632-381d-40c2-90bc-d6ba7a4bc13a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.494237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0636a16-81dc-4628-b0b3-4d01e8c6a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.494898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0636a16-81dc-4628-b0b3-4d01e8c6a4e6 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.495177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0636a16-81dc-4628-b0b3-4d01e8c6a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.495445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0636a16-81dc-4628-b0b3-4d01e8c6a4e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:59.503082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0636a16-81dc-4628-b0b3-4d01e8c6a4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:59.504526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0636a16-81dc-4628-b0b3-4d01e8c6a4e6 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-a0636a16-81dc-4628-b0b3-4d01e8c6a4e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:32:59.516713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:32:59.517986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:32:59.518874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:32:59.518874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:32:59.518874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:32:59.518874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:32:59.518874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:32:59.518874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:32:59.518874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:32:59.518874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:32:59.522520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 262/529] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:32:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:32:59.523365 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0636a16-81dc-4628-b0b3-4d01e8c6a4e6 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.526927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daed23-020a-4684-ae18-55123dca1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.527574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daed23-020a-4684-ae18-55123dca1d73 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.527863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daed23-020a-4684-ae18-55123dca1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.528141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daed23-020a-4684-ae18-55123dca1d73 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:59.528959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daed23-020a-4684-ae18-55123dca1d73 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:59.529193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daed23-020a-4684-ae18-55123dca1d73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:59.530644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daed23-020a-4684-ae18-55123dca1d73 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:59.550948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 268/530] 10.222.0.59 () {56 vars in 1139 bytes} [Wed Aug 24 11:32:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:59.551932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daed23-020a-4684-ae18-55123dca1d73 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.598414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:59.651599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0636a16-81dc-4628-b0b3-4d01e8c6a4e6 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.666142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daed23-020a-4684-ae18-55123dca1d73 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.693892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993f348-fcd8-48d5-814b-69bda7c0303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.694605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f348-fcd8-48d5-814b-69bda7c0303c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.694944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f348-fcd8-48d5-814b-69bda7c0303c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.695223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f348-fcd8-48d5-814b-69bda7c0303c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:59.695954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993f348-fcd8-48d5-814b-69bda7c0303c None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=46e2fac1066d4ad7b670d46f158fec97) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:59.696263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993f348-fcd8-48d5-814b-69bda7c0303c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:59.697707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993f348-fcd8-48d5-814b-69bda7c0303c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:59.705411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 263/531] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:59 2022] GET /identity/v3/role_assignments?user.id=46e2fac1066d4ad7b670d46f158fec97&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:59.706559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993f348-fcd8-48d5-814b-69bda7c0303c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.731076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0104db-659d-40bb-b53a-2ad77fabd766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.731735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0104db-659d-40bb-b53a-2ad77fabd766 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.732026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0104db-659d-40bb-b53a-2ad77fabd766 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.732308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0104db-659d-40bb-b53a-2ad77fabd766 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:59.733098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0104db-659d-40bb-b53a-2ad77fabd766 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:59.733410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0104db-659d-40bb-b53a-2ad77fabd766 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:59.736162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0104db-659d-40bb-b53a-2ad77fabd766 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:59.769306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 269/532] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:32:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:59.769306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0104db-659d-40bb-b53a-2ad77fabd766 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.774176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:59.856564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993f348-fcd8-48d5-814b-69bda7c0303c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.904267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:59.907665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0104db-659d-40bb-b53a-2ad77fabd766 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:32:59.915166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca903a-6d9d-443f-b3dd-72841dcf3d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.916041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca903a-6d9d-443f-b3dd-72841dcf3d04 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.916469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca903a-6d9d-443f-b3dd-72841dcf3d04 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.916924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca903a-6d9d-443f-b3dd-72841dcf3d04 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:32:59.917896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca903a-6d9d-443f-b3dd-72841dcf3d04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:32:59.918354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca903a-6d9d-443f-b3dd-72841dcf3d04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:32:59.920107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca903a-6d9d-443f-b3dd-72841dcf3d04 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:32:59.934639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 264/533] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:32:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:32:59.935798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca903a-6d9d-443f-b3dd-72841dcf3d04 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:32:59.950963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c32a1-c5b6-4a7d-9d38-5b2d07b81a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:32:59.951981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c32a1-c5b6-4a7d-9d38-5b2d07b81a22 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:32:59.952265 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c32a1-c5b6-4a7d-9d38-5b2d07b81a22 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:32:59.952536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c32a1-c5b6-4a7d-9d38-5b2d07b81a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:00.055723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c32a1-c5b6-4a7d-9d38-5b2d07b81a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:00.057611 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c32a1-c5b6-4a7d-9d38-5b2d07b81a22 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:00.089840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca903a-6d9d-443f-b3dd-72841dcf3d04 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:00.092739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:00.135382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad3c8d-8acd-44f5-8a3e-c766ce28533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:00.135998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad3c8d-8acd-44f5-8a3e-c766ce28533f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:00.136277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad3c8d-8acd-44f5-8a3e-c766ce28533f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:00.136610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad3c8d-8acd-44f5-8a3e-c766ce28533f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:00.137345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad3c8d-8acd-44f5-8a3e-c766ce28533f None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=bd3bd33cac7d4715bede59def04cdb92) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:00.137653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad3c8d-8acd-44f5-8a3e-c766ce28533f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:00.139322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad3c8d-8acd-44f5-8a3e-c766ce28533f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:00.147331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 265/534] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:32:59 2022] GET /identity/v3/role_assignments?user.id=bd3bd33cac7d4715bede59def04cdb92&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:00.148255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad3c8d-8acd-44f5-8a3e-c766ce28533f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:00.178410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:00.184975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 270/535] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:32:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:00.195904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c32a1-c5b6-4a7d-9d38-5b2d07b81a22 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:00.289957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad3c8d-8acd-44f5-8a3e-c766ce28533f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:00.332860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1579260-9d69-4f6b-818e-aff3e5edb0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:00.333399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1579260-9d69-4f6b-818e-aff3e5edb0b0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:00.333695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1579260-9d69-4f6b-818e-aff3e5edb0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:00.333955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1579260-9d69-4f6b-818e-aff3e5edb0b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:00.334707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1579260-9d69-4f6b-818e-aff3e5edb0b0 None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=580a07e04f3e42a5bb2801e583a78a1c) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:00.335051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1579260-9d69-4f6b-818e-aff3e5edb0b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:00.338820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1579260-9d69-4f6b-818e-aff3e5edb0b0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:00.345130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 266/536] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:00 2022] GET /identity/v3/role_assignments?user.id=580a07e04f3e42a5bb2801e583a78a1c&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:00.417390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c32a1-c5b6-4a7d-9d38-5b2d07b81a22 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:00.460333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543220e-6c44-4adc-817f-e9f298ad682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:00.461447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543220e-6c44-4adc-817f-e9f298ad682a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:00.461927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543220e-6c44-4adc-817f-e9f298ad682a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:00.462422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543220e-6c44-4adc-817f-e9f298ad682a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:00.480412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543220e-6c44-4adc-817f-e9f298ad682a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:00.482429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543220e-6c44-4adc-817f-e9f298ad682a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-d543220e-6c44-4adc-817f-e9f298ad682a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:00.508239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:00.509203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:00.510273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:00.510273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:00.510273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:00.512315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 271/537] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:00.518489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1579260-9d69-4f6b-818e-aff3e5edb0b0 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:00.575431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:00.662252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1579260-9d69-4f6b-818e-aff3e5edb0b0 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:00.704700 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ddb08-b9ef-413d-b52e-75798717fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:00.705312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ddb08-b9ef-413d-b52e-75798717fe9d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:00.705587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ddb08-b9ef-413d-b52e-75798717fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:00.705855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ddb08-b9ef-413d-b52e-75798717fe9d None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:00.706498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ddb08-b9ef-413d-b52e-75798717fe9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:00.706813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ddb08-b9ef-413d-b52e-75798717fe9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:00.708249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ddb08-b9ef-413d-b52e-75798717fe9d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:00.722691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 267/538] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:00.728437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543220e-6c44-4adc-817f-e9f298ad682a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:00.808266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:00.893307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543220e-6c44-4adc-817f-e9f298ad682a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:00.954728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed5330-0d05-4a48-a2db-de28eda15b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:00.955650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed5330-0d05-4a48-a2db-de28eda15b79 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:00.955939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed5330-0d05-4a48-a2db-de28eda15b79 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:00.956216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed5330-0d05-4a48-a2db-de28eda15b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:00.963790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed5330-0d05-4a48-a2db-de28eda15b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:00.965263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed5330-0d05-4a48-a2db-de28eda15b79 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-d8ed5330-0d05-4a48-a2db-de28eda15b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:00.977857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:00.978745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:00.979636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:00.979636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:00.979636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:00.979636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:00.979636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:00.979636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:00.979636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:00.979636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:00.979636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 272/539] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:00.985760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ddb08-b9ef-413d-b52e-75798717fe9d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:00.993016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf40e-30e2-4c8d-a8d7-586fefe204dc None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:00.993302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf40e-30e2-4c8d-a8d7-586fefe204dc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:00.993576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf40e-30e2-4c8d-a8d7-586fefe204dc None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:00.995387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 273/540] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:01.001965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85769-c3b5-44a1-83ad-524f9ab844ad None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:01.003389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85769-c3b5-44a1-83ad-524f9ab844ad None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:01.004035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85769-c3b5-44a1-83ad-524f9ab844ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:01.041801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-bbd85769-c3b5-44a1-83ad-524f9ab844ad None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:01.044566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-bbd85769-c3b5-44a1-83ad-524f9ab844ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:01.167137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:01.186826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ddb08-b9ef-413d-b52e-75798717fe9d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:01.196412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 274/541] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:01.227993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727e763-192a-4917-ad72-d3dc1ef1fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:01.228811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727e763-192a-4917-ad72-d3dc1ef1fc3d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:01.229194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727e763-192a-4917-ad72-d3dc1ef1fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:01.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727e763-192a-4917-ad72-d3dc1ef1fc3d None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:01.230367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727e763-192a-4917-ad72-d3dc1ef1fc3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:01.230791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727e763-192a-4917-ad72-d3dc1ef1fc3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:01.232406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727e763-192a-4917-ad72-d3dc1ef1fc3d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:01.244681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 268/542] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:01.250727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85769-c3b5-44a1-83ad-524f9ab844ad None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:01.296730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:01.370544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85769-c3b5-44a1-83ad-524f9ab844ad None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:01.415707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e124e4a-d5c3-486f-9c9d-59670d9f7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:01.416321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e124e4a-d5c3-486f-9c9d-59670d9f7295 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:01.416600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e124e4a-d5c3-486f-9c9d-59670d9f7295 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:01.416876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e124e4a-d5c3-486f-9c9d-59670d9f7295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:01.417605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e124e4a-d5c3-486f-9c9d-59670d9f7295 None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=9b072d5669e34ad5b7b52a4a6e26700b) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:01.417913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e124e4a-d5c3-486f-9c9d-59670d9f7295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:01.419382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e124e4a-d5c3-486f-9c9d-59670d9f7295 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:01.426421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 275/543] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:01 2022] GET /identity/v3/role_assignments?user.id=9b072d5669e34ad5b7b52a4a6e26700b&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:01.602738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727e763-192a-4917-ad72-d3dc1ef1fc3d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:01.742131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727e763-192a-4917-ad72-d3dc1ef1fc3d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:01.780019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f6e7d-c2ea-4226-b9d5-51d2c1ceed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:01.780654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f6e7d-c2ea-4226-b9d5-51d2c1ceed3e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:01.780937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f6e7d-c2ea-4226-b9d5-51d2c1ceed3e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:01.781210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f6e7d-c2ea-4226-b9d5-51d2c1ceed3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:01.793062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f6e7d-c2ea-4226-b9d5-51d2c1ceed3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-458f6e7d-c2ea-4226-b9d5-51d2c1ceed3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:01.799126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:01.800216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:01.801276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 269/544] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:01.808157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e124e4a-d5c3-486f-9c9d-59670d9f7295 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:01.942572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e124e4a-d5c3-486f-9c9d-59670d9f7295 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:01.950612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:01.987381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d9f8c-d50b-4dc6-ab1a-30c05e27cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:01.988002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d9f8c-d50b-4dc6-ab1a-30c05e27cc9b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:01.988286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d9f8c-d50b-4dc6-ab1a-30c05e27cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:01.988571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d9f8c-d50b-4dc6-ab1a-30c05e27cc9b None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:01.989254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d9f8c-d50b-4dc6-ab1a-30c05e27cc9b None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:01.989560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d9f8c-d50b-4dc6-ab1a-30c05e27cc9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:01.991044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d9f8c-d50b-4dc6-ab1a-30c05e27cc9b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:02.000444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 276/545] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:02.007849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f6e7d-c2ea-4226-b9d5-51d2c1ceed3e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:02.027476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:02.141867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f6e7d-c2ea-4226-b9d5-51d2c1ceed3e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:02.187424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e883-2b1d-4a1b-9e76-4dc8c755ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:02.188557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e883-2b1d-4a1b-9e76-4dc8c755ee2b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.188839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e883-2b1d-4a1b-9e76-4dc8c755ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.189129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e883-2b1d-4a1b-9e76-4dc8c755ee2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.210669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0e883-2b1d-4a1b-9e76-4dc8c755ee2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:02.212101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0e883-2b1d-4a1b-9e76-4dc8c755ee2b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-ffb0e883-2b1d-4a1b-9e76-4dc8c755ee2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:02.229572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:02.230526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:02.231846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:02.231846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:02.231846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:02.231846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 270/546] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:02.238819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d9f8c-d50b-4dc6-ab1a-30c05e27cc9b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:02.371819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d9f8c-d50b-4dc6-ab1a-30c05e27cc9b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:02.424055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e383e8-d5ca-4707-a517-6dfe6b821e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:02.424686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e383e8-d5ca-4707-a517-6dfe6b821e6c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.424965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e383e8-d5ca-4707-a517-6dfe6b821e6c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.425225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e383e8-d5ca-4707-a517-6dfe6b821e6c None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.425887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e383e8-d5ca-4707-a517-6dfe6b821e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:02.426187 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e383e8-d5ca-4707-a517-6dfe6b821e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:02.427599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e383e8-d5ca-4707-a517-6dfe6b821e6c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:02.444510 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 277/547] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:02.450289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e883-2b1d-4a1b-9e76-4dc8c755ee2b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:02.509405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a62f-9e05-4ab4-9450-3c40e539be5e None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.509588 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a62f-9e05-4ab4-9450-3c40e539be5e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.510114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a62f-9e05-4ab4-9450-3c40e539be5e None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.511638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 278/548] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:02.523015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4e1b0-bad0-49c1-b6f1-99e4001ec63b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.523312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4e1b0-bad0-49c1-b6f1-99e4001ec63b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.523578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4e1b0-bad0-49c1-b6f1-99e4001ec63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.544818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-1ae4e1b0-bad0-49c1-b6f1-99e4001ec63b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:02.546754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1ae4e1b0-bad0-49c1-b6f1-99e4001ec63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:02.563950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:02.576727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:02.605687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e883-2b1d-4a1b-9e76-4dc8c755ee2b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:02.630214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 279/549] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:02.631840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb0cb5-9d7e-4577-b883-3cc9b9aeb4e5 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.632368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb0cb5-9d7e-4577-b883-3cc9b9aeb4e5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.632786 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb0cb5-9d7e-4577-b883-3cc9b9aeb4e5 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.634636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 280/550] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:02.640503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b029d79-5023-4f65-8f4d-31823d3639f1 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.640503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b029d79-5023-4f65-8f4d-31823d3639f1 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.640503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b029d79-5023-4f65-8f4d-31823d3639f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.647482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663bb1d-bb38-4880-842f-584169c15469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:02.648242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663bb1d-bb38-4880-842f-584169c15469 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.648634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663bb1d-bb38-4880-842f-584169c15469 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.648976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663bb1d-bb38-4880-842f-584169c15469 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.658249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663bb1d-bb38-4880-842f-584169c15469 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:02.659816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663bb1d-bb38-4880-842f-584169c15469 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-3663bb1d-bb38-4880-842f-584169c15469 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:02.671728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:02.674081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:02.675400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 271/551] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:02.679799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-5b029d79-5023-4f65-8f4d-31823d3639f1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:02.681010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5b029d79-5023-4f65-8f4d-31823d3639f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:02.682469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663bb1d-bb38-4880-842f-584169c15469 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:02.805370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 281/552] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:02.807186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1652-72dc-41b6-a579-071273f24aec None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.807478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1652-72dc-41b6-a579-071273f24aec None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.807875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1652-72dc-41b6-a579-071273f24aec None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.814425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 282/553] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:02.815716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1499a-6701-40df-9743-9d6954f7d4e6 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.816282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1499a-6701-40df-9743-9d6954f7d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.816559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1499a-6701-40df-9743-9d6954f7d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.821671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663bb1d-bb38-4880-842f-584169c15469 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:02.839040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-33b1499a-6701-40df-9743-9d6954f7d4e6 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:02.840679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-33b1499a-6701-40df-9743-9d6954f7d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:02.853105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:02.868644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbef1d5-4b99-4baa-828a-317f8ca0282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:02.869553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbef1d5-4b99-4baa-828a-317f8ca0282b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:02.869852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbef1d5-4b99-4baa-828a-317f8ca0282b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:02.870127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbef1d5-4b99-4baa-828a-317f8ca0282b None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:02.871049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbef1d5-4b99-4baa-828a-317f8ca0282b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:02.871414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbef1d5-4b99-4baa-828a-317f8ca0282b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:02.873669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbef1d5-4b99-4baa-828a-317f8ca0282b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:02.916665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 272/554] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 11:33:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:02.922713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbef1d5-4b99-4baa-828a-317f8ca0282b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:02.966360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 283/555] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:03.007829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1499a-6701-40df-9743-9d6954f7d4e6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.028225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:03.083737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbef1d5-4b99-4baa-828a-317f8ca0282b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:03.134328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272962a0-ec30-4164-b6fb-4e3d1fe9b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:03.135404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272962a0-ec30-4164-b6fb-4e3d1fe9b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:03.135685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272962a0-ec30-4164-b6fb-4e3d1fe9b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:03.135953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272962a0-ec30-4164-b6fb-4e3d1fe9b3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:03.149797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1499a-6701-40df-9743-9d6954f7d4e6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:03.186439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82707275-15af-4326-a82f-43bcde5de24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:03.187180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82707275-15af-4326-a82f-43bcde5de24f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:03.187715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82707275-15af-4326-a82f-43bcde5de24f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:03.188002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82707275-15af-4326-a82f-43bcde5de24f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:03.190996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:03.200177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82707275-15af-4326-a82f-43bcde5de24f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-82707275-15af-4326-a82f-43bcde5de24f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:03.205427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:03.206447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 284/556] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:03.208381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82707275-15af-4326-a82f-43bcde5de24f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.213166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272962a0-ec30-4164-b6fb-4e3d1fe9b3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:03.214980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272962a0-ec30-4164-b6fb-4e3d1fe9b3a2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:03.299980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:03.325017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82707275-15af-4326-a82f-43bcde5de24f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:03.340168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 273/557] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:03.341922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272962a0-ec30-4164-b6fb-4e3d1fe9b3a2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.375141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e5a02-eaf5-4335-956c-d501d48127a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:03.376055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e5a02-eaf5-4335-956c-d501d48127a4 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:03.376485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e5a02-eaf5-4335-956c-d501d48127a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:03.377008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e5a02-eaf5-4335-956c-d501d48127a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:03.390069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e5a02-eaf5-4335-956c-d501d48127a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-418e5a02-eaf5-4335-956c-d501d48127a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:03.395744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:03.396704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:03.397618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:03.399898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 285/558] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:03.400878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e5a02-eaf5-4335-956c-d501d48127a4 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.455275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:03.477031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272962a0-ec30-4164-b6fb-4e3d1fe9b3a2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:03.512762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2ca4e-df69-4a60-9ef7-37dda91f0672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:03.513814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2ca4e-df69-4a60-9ef7-37dda91f0672 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:03.514397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2ca4e-df69-4a60-9ef7-37dda91f0672 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:03.514959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2ca4e-df69-4a60-9ef7-37dda91f0672 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:03.515637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2ca4e-df69-4a60-9ef7-37dda91f0672 None admin] RBAC: Adding query filter params (name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:03.516543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2ca4e-df69-4a60-9ef7-37dda91f0672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:03.517355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e5a02-eaf5-4335-956c-d501d48127a4 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:03.518144 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2ca4e-df69-4a60-9ef7-37dda91f0672 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:03.533196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 274/559] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:03.533196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2ca4e-df69-4a60-9ef7-37dda91f0672 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.554518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad39e7-7f4b-4764-bb1d-451bc0b7705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:03.555213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad39e7-7f4b-4764-bb1d-451bc0b7705a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:03.555705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad39e7-7f4b-4764-bb1d-451bc0b7705a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:03.555705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad39e7-7f4b-4764-bb1d-451bc0b7705a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:03.562873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:03.567549 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad39e7-7f4b-4764-bb1d-451bc0b7705a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-55ad39e7-7f4b-4764-bb1d-451bc0b7705a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:03.572789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:03.573735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 286/560] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:03.581856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad39e7-7f4b-4764-bb1d-451bc0b7705a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.654817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2ca4e-df69-4a60-9ef7-37dda91f0672 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:03.691758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158c3d-1b9d-4d38-8c02-a0cc6dc3c9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:03.692782 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158c3d-1b9d-4d38-8c02-a0cc6dc3c9c4 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:03.692913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad39e7-7f4b-4764-bb1d-451bc0b7705a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:03.693389 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158c3d-1b9d-4d38-8c02-a0cc6dc3c9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:03.693915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158c3d-1b9d-4d38-8c02-a0cc6dc3c9c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:03.706463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158c3d-1b9d-4d38-8c02-a0cc6dc3c9c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:03.708278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158c3d-1b9d-4d38-8c02-a0cc6dc3c9c4 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:03.711380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-bb158c3d-1b9d-4d38-8c02-a0cc6dc3c9c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:03.726098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:03.727189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:03.728075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:03.728075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:03.728075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:03.728075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 275/561] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:03.728301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158c3d-1b9d-4d38-8c02-a0cc6dc3c9c4 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.737589 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d44fdf-8526-4635-a5bc-c87b823a43b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:03.738205 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d44fdf-8526-4635-a5bc-c87b823a43b0 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:03.738493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d44fdf-8526-4635-a5bc-c87b823a43b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:03.738790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d44fdf-8526-4635-a5bc-c87b823a43b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:03.739491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d44fdf-8526-4635-a5bc-c87b823a43b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:03.739799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d44fdf-8526-4635-a5bc-c87b823a43b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:03.741178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d44fdf-8526-4635-a5bc-c87b823a43b0 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:03.749557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 287/562] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:03.750408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d44fdf-8526-4635-a5bc-c87b823a43b0 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.815613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:03.849943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158c3d-1b9d-4d38-8c02-a0cc6dc3c9c4 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:03.864311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d44fdf-8526-4635-a5bc-c87b823a43b0 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:03.887442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dbba9-f198-47c7-94cf-44a9c51eec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:03.888080 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dbba9-f198-47c7-94cf-44a9c51eec30 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:03.888362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dbba9-f198-47c7-94cf-44a9c51eec30 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:03.888709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dbba9-f198-47c7-94cf-44a9c51eec30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:03.900120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dbba9-f198-47c7-94cf-44a9c51eec30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:03.901559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dbba9-f198-47c7-94cf-44a9c51eec30 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:03.903695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dd854-bdfe-451a-a64a-bb8b13c0c2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:03.904303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dd854-bdfe-451a-a64a-bb8b13c0c2d0 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:03.904582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dd854-bdfe-451a-a64a-bb8b13c0c2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:03.904910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dd854-bdfe-451a-a64a-bb8b13c0c2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:03.905520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dd854-bdfe-451a-a64a-bb8b13c0c2d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:03.905825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dd854-bdfe-451a-a64a-bb8b13c0c2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:03.907722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dd854-bdfe-451a-a64a-bb8b13c0c2d0 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:03.915701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 288/563] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:03.916491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dd854-bdfe-451a-a64a-bb8b13c0c2d0 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-094dbba9-f198-47c7-94cf-44a9c51eec30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:03.916615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:03.917492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:03.918403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:03.918403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:03.918403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:03.918403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 276/564] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:03.918621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dbba9-f198-47c7-94cf-44a9c51eec30 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:03.969910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:04.023423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dbba9-f198-47c7-94cf-44a9c51eec30 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.024718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dd854-bdfe-451a-a64a-bb8b13c0c2d0 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.048634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:04.059084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36d43d-3edc-46e9-8f13-906a3d33f3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.059722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d43d-3edc-46e9-8f13-906a3d33f3b3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.060001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d43d-3edc-46e9-8f13-906a3d33f3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.060272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d43d-3edc-46e9-8f13-906a3d33f3b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.060834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0c2e7-d0ff-48af-ac59-b4d9061cccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.061435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0c2e7-d0ff-48af-ac59-b4d9061cccc9 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.061745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0c2e7-d0ff-48af-ac59-b4d9061cccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.062000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0c2e7-d0ff-48af-ac59-b4d9061cccc9 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.062670 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0c2e7-d0ff-48af-ac59-b4d9061cccc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:04.063006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0c2e7-d0ff-48af-ac59-b4d9061cccc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.065518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0c2e7-d0ff-48af-ac59-b4d9061cccc9 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.072663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36d43d-3edc-46e9-8f13-906a3d33f3b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.074110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36d43d-3edc-46e9-8f13-906a3d33f3b3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.077446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 289/565] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:04.078898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853386e5-ca9b-428a-93e8-4ea066755f33 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.079589 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853386e5-ca9b-428a-93e8-4ea066755f33 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.079864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853386e5-ca9b-428a-93e8-4ea066755f33 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.081091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 290/566] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:04.081993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853386e5-ca9b-428a-93e8-4ea066755f33 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-ec36d43d-3edc-46e9-8f13-906a3d33f3b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:04.091693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:04.093191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:04.094386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:04.094386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:04.094386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:04.094386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 277/567] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:04.094386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36d43d-3edc-46e9-8f13-906a3d33f3b3 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.186118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853386e5-ca9b-428a-93e8-4ea066755f33 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.197051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:04.200158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36d43d-3edc-46e9-8f13-906a3d33f3b3 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.222884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a5a85-2c16-4c21-a6e9-3679655168d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.223522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a5a85-2c16-4c21-a6e9-3679655168d3 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.223803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a5a85-2c16-4c21-a6e9-3679655168d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.224080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a5a85-2c16-4c21-a6e9-3679655168d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.237029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2041a-97e2-400c-a7eb-fd122ec1468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.237638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2041a-97e2-400c-a7eb-fd122ec1468b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.237911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2041a-97e2-400c-a7eb-fd122ec1468b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.238179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2041a-97e2-400c-a7eb-fd122ec1468b None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.238843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2041a-97e2-400c-a7eb-fd122ec1468b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:04.239145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2041a-97e2-400c-a7eb-fd122ec1468b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.240494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2041a-97e2-400c-a7eb-fd122ec1468b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.241308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a5a85-2c16-4c21-a6e9-3679655168d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.242748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a5a85-2c16-4c21-a6e9-3679655168d3 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.253357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 278/568] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:04.254056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2041a-97e2-400c-a7eb-fd122ec1468b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-ad5a5a85-2c16-4c21-a6e9-3679655168d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:04.257387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:04.258429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:04.259338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:04.259338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:04.259338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:04.259338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 291/569] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:04.260762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36472e-1548-4b84-920d-29c3fd0fef40 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.260762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36472e-1548-4b84-920d-29c3fd0fef40 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.260762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36472e-1548-4b84-920d-29c3fd0fef40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.278514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-af36472e-1548-4b84-920d-29c3fd0fef40 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:04.279749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-af36472e-1548-4b84-920d-29c3fd0fef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:04.307066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:04.348341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 292/570] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:04.349184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36472e-1548-4b84-920d-29c3fd0fef40 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.372911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2041a-97e2-400c-a7eb-fd122ec1468b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.411743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd486-bd96-4517-a622-8c1073b2544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.412602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd486-bd96-4517-a622-8c1073b2544c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.413037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd486-bd96-4517-a622-8c1073b2544c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.413303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd486-bd96-4517-a622-8c1073b2544c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.421335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bd486-bd96-4517-a622-8c1073b2544c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.422838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bd486-bd96-4517-a622-8c1073b2544c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-173bd486-bd96-4517-a622-8c1073b2544c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:04.434541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:04.435604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 279/571] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:04.436540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd486-bd96-4517-a622-8c1073b2544c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.458943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36472e-1548-4b84-920d-29c3fd0fef40 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.461302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:04.496171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37704881-0b86-4725-961f-e375b91f1f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.497051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704881-0b86-4725-961f-e375b91f1f5a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.497329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704881-0b86-4725-961f-e375b91f1f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.497761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704881-0b86-4725-961f-e375b91f1f5a None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.498726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37704881-0b86-4725-961f-e375b91f1f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:04.499080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37704881-0b86-4725-961f-e375b91f1f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.501113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37704881-0b86-4725-961f-e375b91f1f5a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.513200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 293/572] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:04.513845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37704881-0b86-4725-961f-e375b91f1f5a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.542957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:04.551673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd486-bd96-4517-a622-8c1073b2544c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.587256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8c4ab-26ee-47b6-b3ec-c3ecc6f134a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.587874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8c4ab-26ee-47b6-b3ec-c3ecc6f134a8 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.588154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8c4ab-26ee-47b6-b3ec-c3ecc6f134a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.588426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8c4ab-26ee-47b6-b3ec-c3ecc6f134a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.595794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8c4ab-26ee-47b6-b3ec-c3ecc6f134a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.597218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8c4ab-26ee-47b6-b3ec-c3ecc6f134a8 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-48f8c4ab-26ee-47b6-b3ec-c3ecc6f134a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:04.610109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:04.611317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 280/573] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:04.612259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8c4ab-26ee-47b6-b3ec-c3ecc6f134a8 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.637076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37704881-0b86-4725-961f-e375b91f1f5a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.671497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaba83-b6ab-4abb-bc52-8b6c87edfdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.672110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaba83-b6ab-4abb-bc52-8b6c87edfdab None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.673120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaba83-b6ab-4abb-bc52-8b6c87edfdab None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.673312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaba83-b6ab-4abb-bc52-8b6c87edfdab None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.673944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acaba83-b6ab-4abb-bc52-8b6c87edfdab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:04.674250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acaba83-b6ab-4abb-bc52-8b6c87edfdab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.675643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acaba83-b6ab-4abb-bc52-8b6c87edfdab None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.691663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 294/574] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:04.691663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaba83-b6ab-4abb-bc52-8b6c87edfdab None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.693671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:04.714718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8c4ab-26ee-47b6-b3ec-c3ecc6f134a8 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.751372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe3db7-408b-41cc-9e1a-618ef9774f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.752862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe3db7-408b-41cc-9e1a-618ef9774f2c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.753148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe3db7-408b-41cc-9e1a-618ef9774f2c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.753428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe3db7-408b-41cc-9e1a-618ef9774f2c None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.754127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe3db7-408b-41cc-9e1a-618ef9774f2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:04.754435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe3db7-408b-41cc-9e1a-618ef9774f2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.755903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe3db7-408b-41cc-9e1a-618ef9774f2c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.770000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 281/575] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:04.770855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe3db7-408b-41cc-9e1a-618ef9774f2c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.778419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:04.796126 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaba83-b6ab-4abb-bc52-8b6c87edfdab None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.831733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1f710-9682-40fd-9d32-8b6df15b75b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.832372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1f710-9682-40fd-9d32-8b6df15b75b7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.832658 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1f710-9682-40fd-9d32-8b6df15b75b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.832930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1f710-9682-40fd-9d32-8b6df15b75b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.840127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1f710-9682-40fd-9d32-8b6df15b75b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.841575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1f710-9682-40fd-9d32-8b6df15b75b7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-11e1f710-9682-40fd-9d32-8b6df15b75b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:04.853843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:04.854913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 295/576] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:04.855872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1f710-9682-40fd-9d32-8b6df15b75b7 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.880762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe3db7-408b-41cc-9e1a-618ef9774f2c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:04.920081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f846afa-1654-43a1-bad8-703485fe1fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:04.920690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f846afa-1654-43a1-bad8-703485fe1fd7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:04.920964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f846afa-1654-43a1-bad8-703485fe1fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:04.921549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f846afa-1654-43a1-bad8-703485fe1fd7 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:04.921963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f846afa-1654-43a1-bad8-703485fe1fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:04.922330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f846afa-1654-43a1-bad8-703485fe1fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:04.923803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f846afa-1654-43a1-bad8-703485fe1fd7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:04.937450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:04.956608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 282/577] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:04.956608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f846afa-1654-43a1-bad8-703485fe1fd7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:04.973458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1f710-9682-40fd-9d32-8b6df15b75b7 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.011951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e646ce7-ba33-4266-98c2-c48010cce535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.012585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e646ce7-ba33-4266-98c2-c48010cce535 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.012865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e646ce7-ba33-4266-98c2-c48010cce535 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.013138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e646ce7-ba33-4266-98c2-c48010cce535 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.024603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e646ce7-ba33-4266-98c2-c48010cce535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-2e646ce7-ba33-4266-98c2-c48010cce535 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:05.029801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:05.037272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 296/578] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:05.038328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e646ce7-ba33-4266-98c2-c48010cce535 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.043217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:05.070711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f846afa-1654-43a1-bad8-703485fe1fd7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.112119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08389dbb-a0df-4932-b15d-c39d0d35c220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.112780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389dbb-a0df-4932-b15d-c39d0d35c220 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.113026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389dbb-a0df-4932-b15d-c39d0d35c220 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.113298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389dbb-a0df-4932-b15d-c39d0d35c220 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.120816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08389dbb-a0df-4932-b15d-c39d0d35c220 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.122339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08389dbb-a0df-4932-b15d-c39d0d35c220 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-08389dbb-a0df-4932-b15d-c39d0d35c220 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:05.135661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:05.136849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:05.137952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 283/579] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:05.139625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08389dbb-a0df-4932-b15d-c39d0d35c220 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.156134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e646ce7-ba33-4266-98c2-c48010cce535 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.192560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310e3e0-9a0d-45fd-9c05-fc6dab8d73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.193096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e3e0-9a0d-45fd-9c05-fc6dab8d73fb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.193377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e3e0-9a0d-45fd-9c05-fc6dab8d73fb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.193649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e3e0-9a0d-45fd-9c05-fc6dab8d73fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.194403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310e3e0-9a0d-45fd-9c05-fc6dab8d73fb None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=d81a9aefdc6c4ada9baca8097927c03a) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:05.194711 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310e3e0-9a0d-45fd-9c05-fc6dab8d73fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.196178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310e3e0-9a0d-45fd-9c05-fc6dab8d73fb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.199528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:05.201982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 297/580] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/role_assignments?user.id=d81a9aefdc6c4ada9baca8097927c03a&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:05.202822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310e3e0-9a0d-45fd-9c05-fc6dab8d73fb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.254059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08389dbb-a0df-4932-b15d-c39d0d35c220 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.294576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:05.298103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e32da-a7fa-42c7-a9a9-3be2bf407af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.299145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e32da-a7fa-42c7-a9a9-3be2bf407af1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.299535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e32da-a7fa-42c7-a9a9-3be2bf407af1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.300021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e32da-a7fa-42c7-a9a9-3be2bf407af1 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.300807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e32da-a7fa-42c7-a9a9-3be2bf407af1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:05.301226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e32da-a7fa-42c7-a9a9-3be2bf407af1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.303799 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e32da-a7fa-42c7-a9a9-3be2bf407af1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.329269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 284/581] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:05.329269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e32da-a7fa-42c7-a9a9-3be2bf407af1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.343048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310e3e0-9a0d-45fd-9c05-fc6dab8d73fb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.387878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ed0ce-d435-4f46-9e2a-fe63bd3c78c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.388986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ed0ce-d435-4f46-9e2a-fe63bd3c78c0 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.389667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ed0ce-d435-4f46-9e2a-fe63bd3c78c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.390201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ed0ce-d435-4f46-9e2a-fe63bd3c78c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.402642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ed0ce-d435-4f46-9e2a-fe63bd3c78c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.404239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ed0ce-d435-4f46-9e2a-fe63bd3c78c0 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-e10ed0ce-d435-4f46-9e2a-fe63bd3c78c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:05.419084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:05.420264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:05.421335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:05.421335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:05.421335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:05.425719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 298/582] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:05.426514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ed0ce-d435-4f46-9e2a-fe63bd3c78c0 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.449174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e32da-a7fa-42c7-a9a9-3be2bf407af1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.470012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:05.496550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d925b-f963-4245-91c7-e9b8bdcb4a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.497262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d925b-f963-4245-91c7-e9b8bdcb4a4e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.497602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d925b-f963-4245-91c7-e9b8bdcb4a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.497939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d925b-f963-4245-91c7-e9b8bdcb4a4e None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.498679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d925b-f963-4245-91c7-e9b8bdcb4a4e None admin] RBAC: Adding query filter params (name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:05.499182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d925b-f963-4245-91c7-e9b8bdcb4a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.500971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d925b-f963-4245-91c7-e9b8bdcb4a4e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.510604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 285/583] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:05.511536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d925b-f963-4245-91c7-e9b8bdcb4a4e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.550107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ed0ce-d435-4f46-9e2a-fe63bd3c78c0 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.573388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:05.590647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b21e1-8185-4061-93bd-fa90b5d1a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.591530 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b21e1-8185-4061-93bd-fa90b5d1a4e6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.591971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b21e1-8185-4061-93bd-fa90b5d1a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.592243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b21e1-8185-4061-93bd-fa90b5d1a4e6 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.593004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b21e1-8185-4061-93bd-fa90b5d1a4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:05.593313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b21e1-8185-4061-93bd-fa90b5d1a4e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.595432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b21e1-8185-4061-93bd-fa90b5d1a4e6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.618048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 299/584] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:05.618048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b21e1-8185-4061-93bd-fa90b5d1a4e6 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.637695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d925b-f963-4245-91c7-e9b8bdcb4a4e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.689387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efba5a-14ce-4e47-8448-6c108c697dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.690134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efba5a-14ce-4e47-8448-6c108c697dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.690520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efba5a-14ce-4e47-8448-6c108c697dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.690888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efba5a-14ce-4e47-8448-6c108c697dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.705146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efba5a-14ce-4e47-8448-6c108c697dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.706631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efba5a-14ce-4e47-8448-6c108c697dd0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-b8efba5a-14ce-4e47-8448-6c108c697dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:05.722597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:05.723586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:05.724463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:05.724463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:05.724463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:05.724463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 286/585] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:05.724684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efba5a-14ce-4e47-8448-6c108c697dd0 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.727315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b21e1-8185-4061-93bd-fa90b5d1a4e6 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.763043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:05.768349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258424e-5d25-4411-87cf-d62f6d64e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.769073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258424e-5d25-4411-87cf-d62f6d64e7cd None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.769449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258424e-5d25-4411-87cf-d62f6d64e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.769821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258424e-5d25-4411-87cf-d62f6d64e7cd None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.770580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258424e-5d25-4411-87cf-d62f6d64e7cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:05.770919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258424e-5d25-4411-87cf-d62f6d64e7cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.772291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258424e-5d25-4411-87cf-d62f6d64e7cd None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.784443 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 300/586] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:05.785248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258424e-5d25-4411-87cf-d62f6d64e7cd None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.835596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:05.853060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efba5a-14ce-4e47-8448-6c108c697dd0 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.896657 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1ba2c-8404-410a-aa8c-dc7b0333b28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.897292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1ba2c-8404-410a-aa8c-dc7b0333b28c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.897572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1ba2c-8404-410a-aa8c-dc7b0333b28c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.897841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1ba2c-8404-410a-aa8c-dc7b0333b28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.908602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1ba2c-8404-410a-aa8c-dc7b0333b28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.910050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1ba2c-8404-410a-aa8c-dc7b0333b28c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.913276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258424e-5d25-4411-87cf-d62f6d64e7cd None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-c2f1ba2c-8404-410a-aa8c-dc7b0333b28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:05.924465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:05.925585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:05.926655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:05.926655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:05.926655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:05.930403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 287/587] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:05.931336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1ba2c-8404-410a-aa8c-dc7b0333b28c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:05.963306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b7198-67b5-48a3-89ef-394a26a1586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:05.964215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b7198-67b5-48a3-89ef-394a26a1586d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:05.964677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b7198-67b5-48a3-89ef-394a26a1586d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:05.965204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b7198-67b5-48a3-89ef-394a26a1586d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:05.977763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b7198-67b5-48a3-89ef-394a26a1586d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:05.979366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b7198-67b5-48a3-89ef-394a26a1586d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-8c7b7198-67b5-48a3-89ef-394a26a1586d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:05.995752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:05.996909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:06.003432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:06.003432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:06.003432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:06.003432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 301/588] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:06.003432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b7198-67b5-48a3-89ef-394a26a1586d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.026987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:06.046162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1ba2c-8404-410a-aa8c-dc7b0333b28c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.081608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fbdda-2f3e-4d1b-b4da-3f7d949d0255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.082312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fbdda-2f3e-4d1b-b4da-3f7d949d0255 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.082660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fbdda-2f3e-4d1b-b4da-3f7d949d0255 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.083042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fbdda-2f3e-4d1b-b4da-3f7d949d0255 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.083781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fbdda-2f3e-4d1b-b4da-3f7d949d0255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:06.084082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fbdda-2f3e-4d1b-b4da-3f7d949d0255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.085463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fbdda-2f3e-4d1b-b4da-3f7d949d0255 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.098501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 288/589] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:06.099512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fbdda-2f3e-4d1b-b4da-3f7d949d0255 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.120152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:06.134155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b7198-67b5-48a3-89ef-394a26a1586d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.177991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed721af-0aec-4924-9692-57136998ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.178557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed721af-0aec-4924-9692-57136998ad6b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.178871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed721af-0aec-4924-9692-57136998ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.179147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed721af-0aec-4924-9692-57136998ad6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.188802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed721af-0aec-4924-9692-57136998ad6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.190396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed721af-0aec-4924-9692-57136998ad6b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-4ed721af-0aec-4924-9692-57136998ad6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:06.201730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:06.202847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:06.204289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:06.204289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:06.204289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:06.204289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:06.204289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:06.204289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:06.204289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:06.204289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:06.207659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 302/590] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:06.208464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed721af-0aec-4924-9692-57136998ad6b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.213970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fbdda-2f3e-4d1b-b4da-3f7d949d0255 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.255029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724c18b-1fa6-46bb-9903-df4fec31659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.255800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724c18b-1fa6-46bb-9903-df4fec31659c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.256267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724c18b-1fa6-46bb-9903-df4fec31659c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.256615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724c18b-1fa6-46bb-9903-df4fec31659c None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.257331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724c18b-1fa6-46bb-9903-df4fec31659c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:06.257701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724c18b-1fa6-46bb-9903-df4fec31659c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.259300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724c18b-1fa6-46bb-9903-df4fec31659c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.277393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 289/591] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:06.277393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724c18b-1fa6-46bb-9903-df4fec31659c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.277393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:06.318878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed721af-0aec-4924-9692-57136998ad6b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.358086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161366fb-e40b-49fe-af32-12f724f48372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.358862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161366fb-e40b-49fe-af32-12f724f48372 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.359256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161366fb-e40b-49fe-af32-12f724f48372 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.359630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161366fb-e40b-49fe-af32-12f724f48372 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.360463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161366fb-e40b-49fe-af32-12f724f48372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:06.360929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161366fb-e40b-49fe-af32-12f724f48372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.362404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161366fb-e40b-49fe-af32-12f724f48372 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.378815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 303/592] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:06.378815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161366fb-e40b-49fe-af32-12f724f48372 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.389579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:06.392051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724c18b-1fa6-46bb-9903-df4fec31659c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.426489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0fa76-d87b-475a-8188-71f452a7d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.427569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0fa76-d87b-475a-8188-71f452a7d0bc None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.427854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0fa76-d87b-475a-8188-71f452a7d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.428128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0fa76-d87b-475a-8188-71f452a7d0bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.435607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0fa76-d87b-475a-8188-71f452a7d0bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.437071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0fa76-d87b-475a-8188-71f452a7d0bc None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-7bc0fa76-d87b-475a-8188-71f452a7d0bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:06.450148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:06.451894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:06.454302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:06.454302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:06.454302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:06.454302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:06.454302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:06.454302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:06.454302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:06.454302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:06.456675 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 290/593] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:06.457416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0fa76-d87b-475a-8188-71f452a7d0bc None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.494323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161366fb-e40b-49fe-af32-12f724f48372 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.523595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:06.533491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05a35b-4a54-4cfa-835e-424316fae369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.534086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05a35b-4a54-4cfa-835e-424316fae369 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.534369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05a35b-4a54-4cfa-835e-424316fae369 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.534643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05a35b-4a54-4cfa-835e-424316fae369 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.535369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05a35b-4a54-4cfa-835e-424316fae369 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:06.535734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05a35b-4a54-4cfa-835e-424316fae369 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.537199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05a35b-4a54-4cfa-835e-424316fae369 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.554536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 304/594] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:06.554536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05a35b-4a54-4cfa-835e-424316fae369 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.572280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0fa76-d87b-475a-8188-71f452a7d0bc None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.607939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abe9c4-7d43-49ac-b8be-927f071cd77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.608698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abe9c4-7d43-49ac-b8be-927f071cd77b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.609048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abe9c4-7d43-49ac-b8be-927f071cd77b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.609388 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abe9c4-7d43-49ac-b8be-927f071cd77b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.617563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abe9c4-7d43-49ac-b8be-927f071cd77b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.619037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abe9c4-7d43-49ac-b8be-927f071cd77b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.629781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-99abe9c4-7d43-49ac-b8be-927f071cd77b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:06.631171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:06.632319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:06.633268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 291/595] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:06.633835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abe9c4-7d43-49ac-b8be-927f071cd77b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.674448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05a35b-4a54-4cfa-835e-424316fae369 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.711922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fcf04-da3e-4f7f-988b-be9504b9bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.712846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fcf04-da3e-4f7f-988b-be9504b9bb6b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.713313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fcf04-da3e-4f7f-988b-be9504b9bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.713771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fcf04-da3e-4f7f-988b-be9504b9bb6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.722201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fcf04-da3e-4f7f-988b-be9504b9bb6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.724061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fcf04-da3e-4f7f-988b-be9504b9bb6b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-790fcf04-da3e-4f7f-988b-be9504b9bb6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:06.736920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:06.738030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:06.739154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:06.739154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:06.739154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:06.739154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:06.739154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:06.739154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:06.739154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:06.739154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:06.744016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 305/596] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:06.744944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fcf04-da3e-4f7f-988b-be9504b9bb6b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.745627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abe9c4-7d43-49ac-b8be-927f071cd77b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.771794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:06.787205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998fb39-f916-4849-a897-022955a73534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.787890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998fb39-f916-4849-a897-022955a73534 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.791140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998fb39-f916-4849-a897-022955a73534 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.791140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998fb39-f916-4849-a897-022955a73534 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.791140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998fb39-f916-4849-a897-022955a73534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:06.791140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998fb39-f916-4849-a897-022955a73534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.791140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998fb39-f916-4849-a897-022955a73534 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.803758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 292/597] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:06.804618 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998fb39-f916-4849-a897-022955a73534 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.867335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fcf04-da3e-4f7f-988b-be9504b9bb6b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.902949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:06.909691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5fd90-063e-4050-8767-6fd37eb014d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.910443 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5fd90-063e-4050-8767-6fd37eb014d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.910811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5fd90-063e-4050-8767-6fd37eb014d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.911158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5fd90-063e-4050-8767-6fd37eb014d9 None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/46e2fac1066d4ad7b670d46f158fec97/roles/4631f2d361794b9e9e39f07bdc207d1e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.917943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998fb39-f916-4849-a897-022955a73534 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:06.926526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5fd90-063e-4050-8767-6fd37eb014d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=46e2fac1066d4ad7b670d46f158fec97, role_id=4631f2d361794b9e9e39f07bdc207d1e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.929989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5fd90-063e-4050-8767-6fd37eb014d9 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.962801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 306/598] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:33:06 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/46e2fac1066d4ad7b670d46f158fec97/roles/4631f2d361794b9e9e39f07bdc207d1e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:06.962801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5fd90-063e-4050-8767-6fd37eb014d9 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:06.963140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78719af3-2142-449b-84b8-f7d388a95c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:06.963140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78719af3-2142-449b-84b8-f7d388a95c7c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:06.963315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78719af3-2142-449b-84b8-f7d388a95c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:06.963612 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78719af3-2142-449b-84b8-f7d388a95c7c None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:06.964450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78719af3-2142-449b-84b8-f7d388a95c7c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:06.965042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78719af3-2142-449b-84b8-f7d388a95c7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:06.966740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78719af3-2142-449b-84b8-f7d388a95c7c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:06.989188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 293/599] 10.222.0.59 () {56 vars in 1139 bytes} [Wed Aug 24 11:33:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:06.990320 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78719af3-2142-449b-84b8-f7d388a95c7c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:07.044951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:07.103162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5fd90-063e-4050-8767-6fd37eb014d9 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:07.128415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78719af3-2142-449b-84b8-f7d388a95c7c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:07.143423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6fe4-5130-4154-9479-29978a38e000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:07.144043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6fe4-5130-4154-9479-29978a38e000 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:07.144323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6fe4-5130-4154-9479-29978a38e000 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:07.144596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b6fe4-5130-4154-9479-29978a38e000 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:07.145430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b6fe4-5130-4154-9479-29978a38e000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:07.145737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b6fe4-5130-4154-9479-29978a38e000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:07.147442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b6fe4-5130-4154-9479-29978a38e000 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:07.161325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 307/600] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:07.162224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6fe4-5130-4154-9479-29978a38e000 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:07.176420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fee28-f751-4105-8513-c6bf2490dfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:07.177541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fee28-f751-4105-8513-c6bf2490dfe7 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:07.177833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fee28-f751-4105-8513-c6bf2490dfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:07.178106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fee28-f751-4105-8513-c6bf2490dfe7 None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/580a07e04f3e42a5bb2801e583a78a1c/roles/4631f2d361794b9e9e39f07bdc207d1e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:07.197075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fee28-f751-4105-8513-c6bf2490dfe7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=580a07e04f3e42a5bb2801e583a78a1c, role_id=4631f2d361794b9e9e39f07bdc207d1e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:07.198888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fee28-f751-4105-8513-c6bf2490dfe7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:07.216339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:07.216542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 294/601] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:33:06 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/580a07e04f3e42a5bb2801e583a78a1c/roles/4631f2d361794b9e9e39f07bdc207d1e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:07.221680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fee28-f751-4105-8513-c6bf2490dfe7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:07.335208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b6fe4-5130-4154-9479-29978a38e000 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:07.386426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fee28-f751-4105-8513-c6bf2490dfe7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:07.390076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05473e1e-1597-43b7-a69f-d02610aa5b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:07.390661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:07.390873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05473e1e-1597-43b7-a69f-d02610aa5b60 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:07.391908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05473e1e-1597-43b7-a69f-d02610aa5b60 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:07.392504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05473e1e-1597-43b7-a69f-d02610aa5b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:07.406037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05473e1e-1597-43b7-a69f-d02610aa5b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:07.407877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05473e1e-1597-43b7-a69f-d02610aa5b60 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-05473e1e-1597-43b7-a69f-d02610aa5b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:07.425116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:07.426120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:07.427087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:07.427087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:07.427087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:07.427087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 308/602] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:07.427999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4071e-0ff9-4a7b-be6a-970bf6dcd26c None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:07.428285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4071e-0ff9-4a7b-be6a-970bf6dcd26c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:07.428560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4071e-0ff9-4a7b-be6a-970bf6dcd26c None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:07.429967 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 309/603] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:07.434831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4071e-0ff9-4a7b-be6a-970bf6dcd26c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:07.444033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62535d-0493-4274-bf1f-1f5cb33bef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:07.444827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62535d-0493-4274-bf1f-1f5cb33bef07 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:07.445299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62535d-0493-4274-bf1f-1f5cb33bef07 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:07.445644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62535d-0493-4274-bf1f-1f5cb33bef07 None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/bd3bd33cac7d4715bede59def04cdb92/roles/4631f2d361794b9e9e39f07bdc207d1e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:07.464465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62535d-0493-4274-bf1f-1f5cb33bef07 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=bd3bd33cac7d4715bede59def04cdb92, role_id=4631f2d361794b9e9e39f07bdc207d1e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:07.466264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62535d-0493-4274-bf1f-1f5cb33bef07 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:07.482104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 295/604] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:33:07 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/bd3bd33cac7d4715bede59def04cdb92/roles/4631f2d361794b9e9e39f07bdc207d1e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:07.483997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516a877-d7ae-4357-828d-e93a27f0aa12 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:07.484711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516a877-d7ae-4357-828d-e93a27f0aa12 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:07.485249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516a877-d7ae-4357-828d-e93a27f0aa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:07.506044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f516a877-d7ae-4357-828d-e93a27f0aa12 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:07.507718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f516a877-d7ae-4357-828d-e93a27f0aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:07.562040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:07.573492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4071e-0ff9-4a7b-be6a-970bf6dcd26c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:07.591250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 296/605] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:07.623332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54f578-6425-4a04-8484-36be95843fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:07.623969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f578-6425-4a04-8484-36be95843fb8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:07.624247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f578-6425-4a04-8484-36be95843fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:07.624517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f578-6425-4a04-8484-36be95843fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:07.625196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f578-6425-4a04-8484-36be95843fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:07.625477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f578-6425-4a04-8484-36be95843fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:07.626933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f578-6425-4a04-8484-36be95843fb8 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:07.641048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 310/606] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:07.646667 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516a877-d7ae-4357-828d-e93a27f0aa12 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:07.730890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:07.767095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516a877-d7ae-4357-828d-e93a27f0aa12 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:07.804786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb130e-a853-4281-9448-0960547c6963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:07.805488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb130e-a853-4281-9448-0960547c6963 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:07.805764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb130e-a853-4281-9448-0960547c6963 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:07.806033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb130e-a853-4281-9448-0960547c6963 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:07.813451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb130e-a853-4281-9448-0960547c6963 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:07.814992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb130e-a853-4281-9448-0960547c6963 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-64fb130e-a853-4281-9448-0960547c6963 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:07.827357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:07.828269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:07.829765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:07.829765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:07.829765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:07.829765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:07.829765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:07.829765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:07.829765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:07.829765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:07.829765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 297/607] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:07.835174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54f578-6425-4a04-8484-36be95843fb8 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:07.921856 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb130e-a853-4281-9448-0960547c6963 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:07.952234 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54f578-6425-4a04-8484-36be95843fb8 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:07.996257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5ad61-9ca4-4a98-9825-e0cf8f584774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:07.996867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5ad61-9ca4-4a98-9825-e0cf8f584774 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:07.997972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5ad61-9ca4-4a98-9825-e0cf8f584774 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:07.998245 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5ad61-9ca4-4a98-9825-e0cf8f584774 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:07.998960 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5ad61-9ca4-4a98-9825-e0cf8f584774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:07.999264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5ad61-9ca4-4a98-9825-e0cf8f584774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:08.001339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5ad61-9ca4-4a98-9825-e0cf8f584774 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:08.035149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 311/608] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:08.039023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5ad61-9ca4-4a98-9825-e0cf8f584774 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:08.066926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:08.116352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb130e-a853-4281-9448-0960547c6963 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:08.147415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:08.153783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f546-ddfd-4c0e-ae3f-96e4036eb0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:08.154415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f546-ddfd-4c0e-ae3f-96e4036eb0e1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:08.154697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f546-ddfd-4c0e-ae3f-96e4036eb0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:08.154995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f546-ddfd-4c0e-ae3f-96e4036eb0e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:08.166722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50f546-ddfd-4c0e-ae3f-96e4036eb0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-0e50f546-ddfd-4c0e-ae3f-96e4036eb0e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:08.171510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:08.173840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:08.175580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 298/609] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:08.179639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f546-ddfd-4c0e-ae3f-96e4036eb0e1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:08.184934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5ad61-9ca4-4a98-9825-e0cf8f584774 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:08.252433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837de2e-8a7c-4fe1-a030-b2812b9a1710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:08.253260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837de2e-8a7c-4fe1-a030-b2812b9a1710 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:08.253637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837de2e-8a7c-4fe1-a030-b2812b9a1710 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:08.254012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837de2e-8a7c-4fe1-a030-b2812b9a1710 None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/9b072d5669e34ad5b7b52a4a6e26700b/roles/4631f2d361794b9e9e39f07bdc207d1e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:08.270291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837de2e-8a7c-4fe1-a030-b2812b9a1710 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=9b072d5669e34ad5b7b52a4a6e26700b, role_id=4631f2d361794b9e9e39f07bdc207d1e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:08.272014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837de2e-8a7c-4fe1-a030-b2812b9a1710 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:08.287290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 312/610] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:33:08 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/9b072d5669e34ad5b7b52a4a6e26700b/roles/4631f2d361794b9e9e39f07bdc207d1e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:33:08.294935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f546-ddfd-4c0e-ae3f-96e4036eb0e1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:08.334244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e373af9-4ff5-4082-974d-a5b8e6015571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:08.334935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e373af9-4ff5-4082-974d-a5b8e6015571 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:08.335220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e373af9-4ff5-4082-974d-a5b8e6015571 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:08.335488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e373af9-4ff5-4082-974d-a5b8e6015571 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:08.336157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e373af9-4ff5-4082-974d-a5b8e6015571 None admin] RBAC: Adding query filter params (name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:08.336459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e373af9-4ff5-4082-974d-a5b8e6015571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:08.337822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e373af9-4ff5-4082-974d-a5b8e6015571 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:08.348295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 299/611] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:08.353800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837de2e-8a7c-4fe1-a030-b2812b9a1710 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:08.429482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:08.475182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837de2e-8a7c-4fe1-a030-b2812b9a1710 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:08.525288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72e4bd-f6bd-4502-8414-06316e0c9ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:08.526372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72e4bd-f6bd-4502-8414-06316e0c9ad6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:08.526881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72e4bd-f6bd-4502-8414-06316e0c9ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:08.527344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72e4bd-f6bd-4502-8414-06316e0c9ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:08.543750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72e4bd-f6bd-4502-8414-06316e0c9ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:08.545210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72e4bd-f6bd-4502-8414-06316e0c9ad6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-da72e4bd-f6bd-4502-8414-06316e0c9ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:08.566732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:08.569288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:08.571398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:08.571398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:08.571398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:08.571398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 313/612] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:08.576310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e373af9-4ff5-4082-974d-a5b8e6015571 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:08.633905 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:08.688922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e373af9-4ff5-4082-974d-a5b8e6015571 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:08.729443 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6933a7-6be9-4ce0-a623-7195d476d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:08.730302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6933a7-6be9-4ce0-a623-7195d476d57e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:08.730730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6933a7-6be9-4ce0-a623-7195d476d57e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:08.731195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6933a7-6be9-4ce0-a623-7195d476d57e None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:08.731985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6933a7-6be9-4ce0-a623-7195d476d57e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:08.732436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6933a7-6be9-4ce0-a623-7195d476d57e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:08.733988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6933a7-6be9-4ce0-a623-7195d476d57e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:08.747670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 300/613] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:08.752426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72e4bd-f6bd-4502-8414-06316e0c9ad6 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:08.882366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72e4bd-f6bd-4502-8414-06316e0c9ad6 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:08.904432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:08.926375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7cb4a-47fb-4174-b0c0-593842bcd192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:08.932541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7cb4a-47fb-4174-b0c0-593842bcd192 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:08.933027 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7cb4a-47fb-4174-b0c0-593842bcd192 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:08.933456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7cb4a-47fb-4174-b0c0-593842bcd192 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:08.951478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7cb4a-47fb-4174-b0c0-593842bcd192 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:08.954265 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7cb4a-47fb-4174-b0c0-593842bcd192 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-6df7cb4a-47fb-4174-b0c0-593842bcd192 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:08.970941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:08.972148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:08.973303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:08.975540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 314/614] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:08.980784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6933a7-6be9-4ce0-a623-7195d476d57e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:09.119717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6933a7-6be9-4ce0-a623-7195d476d57e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:09.140692 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:09.175161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af33ae-1e60-4220-b7f6-5e822bcd133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:09.175795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af33ae-1e60-4220-b7f6-5e822bcd133c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:09.176076 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af33ae-1e60-4220-b7f6-5e822bcd133c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:09.176350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af33ae-1e60-4220-b7f6-5e822bcd133c None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:09.177112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af33ae-1e60-4220-b7f6-5e822bcd133c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:09.177420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af33ae-1e60-4220-b7f6-5e822bcd133c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:09.178933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af33ae-1e60-4220-b7f6-5e822bcd133c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:09.204547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 301/615] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 11:33:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:09.215886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7cb4a-47fb-4174-b0c0-593842bcd192 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:09.351999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7cb4a-47fb-4174-b0c0-593842bcd192 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:09.392861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50860059-d891-42ec-b703-aeeca0fb8ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:09.393508 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860059-d891-42ec-b703-aeeca0fb8ab6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:09.393788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860059-d891-42ec-b703-aeeca0fb8ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:09.394060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860059-d891-42ec-b703-aeeca0fb8ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:09.405471 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50860059-d891-42ec-b703-aeeca0fb8ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:09.407780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50860059-d891-42ec-b703-aeeca0fb8ab6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-50860059-d891-42ec-b703-aeeca0fb8ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:09.422994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:09.423988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:09.424877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:09.424877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:09.424877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:09.424877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 315/616] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:09.429839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af33ae-1e60-4220-b7f6-5e822bcd133c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:09.534615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dbac-46fd-4255-9ec9-c0b19d0c1b94 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:09.534935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dbac-46fd-4255-9ec9-c0b19d0c1b94 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:09.535145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dbac-46fd-4255-9ec9-c0b19d0c1b94 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:09.536744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 316/617] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:09.541781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b62685-2ff9-4116-aa14-235998f173bd None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:09.542066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b62685-2ff9-4116-aa14-235998f173bd None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:09.542342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b62685-2ff9-4116-aa14-235998f173bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:09.572223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b5b62685-2ff9-4116-aa14-235998f173bd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:09.573415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b5b62685-2ff9-4116-aa14-235998f173bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:09.579446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af33ae-1e60-4220-b7f6-5e822bcd133c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:09.610597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:09.615585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452aa0eb-43a4-4241-81bd-12270a5fd363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:09.616201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aa0eb-43a4-4241-81bd-12270a5fd363 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:09.616484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aa0eb-43a4-4241-81bd-12270a5fd363 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:09.616759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aa0eb-43a4-4241-81bd-12270a5fd363 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:09.617451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452aa0eb-43a4-4241-81bd-12270a5fd363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:09.617708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452aa0eb-43a4-4241-81bd-12270a5fd363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:09.619319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452aa0eb-43a4-4241-81bd-12270a5fd363 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:09.632453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 302/618] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:09.638993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452aa0eb-43a4-4241-81bd-12270a5fd363 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:09.684318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:09.688871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 317/619] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:09.690412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae205d6-4534-4434-9030-dc46d052adb3 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:09.691574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae205d6-4534-4434-9030-dc46d052adb3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:09.691872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae205d6-4534-4434-9030-dc46d052adb3 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:09.697456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 318/620] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:09.699651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8184-106f-475d-8b38-c764c8cc813b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:09.699981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8184-106f-475d-8b38-c764c8cc813b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:09.700261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8184-106f-475d-8b38-c764c8cc813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:09.732029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-06ab8184-106f-475d-8b38-c764c8cc813b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:09.736048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-06ab8184-106f-475d-8b38-c764c8cc813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:09.817884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452aa0eb-43a4-4241-81bd-12270a5fd363 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:09.862670 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 319/621] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:09.883665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eafab-4c66-4cdb-ba15-a161368f9784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:09.884660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eafab-4c66-4cdb-ba15-a161368f9784 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:09.885415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eafab-4c66-4cdb-ba15-a161368f9784 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:09.886090 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eafab-4c66-4cdb-ba15-a161368f9784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:09.898503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eafab-4c66-4cdb-ba15-a161368f9784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:09.900409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eafab-4c66-4cdb-ba15-a161368f9784 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-651eafab-4c66-4cdb-ba15-a161368f9784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:09.917520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:09.918499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:09.919404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:09.919404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:09.919404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:09.919404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:09.919404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:09.919404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:09.919404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:09.919404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:09.921825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 303/622] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:09.933307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8184-106f-475d-8b38-c764c8cc813b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:09.972045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eafab-4c66-4cdb-ba15-a161368f9784 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:10.104500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:10.118030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eafab-4c66-4cdb-ba15-a161368f9784 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:10.120059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:10.142976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8184-106f-475d-8b38-c764c8cc813b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:10.184056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7e7d2-be71-4236-b498-4a8f5ac5863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:10.185012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7e7d2-be71-4236-b498-4a8f5ac5863f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.185293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7e7d2-be71-4236-b498-4a8f5ac5863f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.185767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7e7d2-be71-4236-b498-4a8f5ac5863f None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.186472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7e7d2-be71-4236-b498-4a8f5ac5863f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:10.186937 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7e7d2-be71-4236-b498-4a8f5ac5863f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:10.189425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7e7d2-be71-4236-b498-4a8f5ac5863f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:10.204622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 320/623] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:10.205590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7e7d2-be71-4236-b498-4a8f5ac5863f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:10.213676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecabed7-ab84-485b-aec6-23f4d02e7f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:10.214325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecabed7-ab84-485b-aec6-23f4d02e7f67 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.214603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecabed7-ab84-485b-aec6-23f4d02e7f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.214899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecabed7-ab84-485b-aec6-23f4d02e7f67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.233576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecabed7-ab84-485b-aec6-23f4d02e7f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-eecabed7-ab84-485b-aec6-23f4d02e7f67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:10.239994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:10.241152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:10.242102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:10.242852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 304/624] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:10.248539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecabed7-ab84-485b-aec6-23f4d02e7f67 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:10.337982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7e7d2-be71-4236-b498-4a8f5ac5863f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:10.367855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecabed7-ab84-485b-aec6-23f4d02e7f67 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:10.382707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1aa22-2baf-4db8-9006-ea331249bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:10.383366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1aa22-2baf-4db8-9006-ea331249bda8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.383645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1aa22-2baf-4db8-9006-ea331249bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.383912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1aa22-2baf-4db8-9006-ea331249bda8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.396323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1aa22-2baf-4db8-9006-ea331249bda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-76c1aa22-2baf-4db8-9006-ea331249bda8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:10.401496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:10.402407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:10.403305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 321/625] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:10.404359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cfc87-f0e9-466e-95ef-88530d50e077 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.404359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cfc87-f0e9-466e-95ef-88530d50e077 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.404359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cfc87-f0e9-466e-95ef-88530d50e077 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.405776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 322/626] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:10.410816 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cfc87-f0e9-466e-95ef-88530d50e077 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:10.411316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e74c3-2fd5-4113-ab27-bcf18cfb0d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:10.412215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e74c3-2fd5-4113-ab27-bcf18cfb0d88 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.412718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e74c3-2fd5-4113-ab27-bcf18cfb0d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.413190 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e74c3-2fd5-4113-ab27-bcf18cfb0d88 None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/d81a9aefdc6c4ada9baca8097927c03a/roles/4631f2d361794b9e9e39f07bdc207d1e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.420221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:10.432224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e74c3-2fd5-4113-ab27-bcf18cfb0d88 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=d81a9aefdc6c4ada9baca8097927c03a, role_id=4631f2d361794b9e9e39f07bdc207d1e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:10.433683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e74c3-2fd5-4113-ab27-bcf18cfb0d88 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:10.444239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:10.449831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 305/627] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:33:10 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/d81a9aefdc6c4ada9baca8097927c03a/roles/4631f2d361794b9e9e39f07bdc207d1e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:10.452084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e74c3-2fd5-4113-ab27-bcf18cfb0d88 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:10.566755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cfc87-f0e9-466e-95ef-88530d50e077 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:10.591469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e74c3-2fd5-4113-ab27-bcf18cfb0d88 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:10.611692 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b959b8-132f-4a9d-98d3-701031bba09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:10.612521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b959b8-132f-4a9d-98d3-701031bba09d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.612934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b959b8-132f-4a9d-98d3-701031bba09d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.613309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b959b8-132f-4a9d-98d3-701031bba09d None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.614355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b959b8-132f-4a9d-98d3-701031bba09d None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:10.614551 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b959b8-132f-4a9d-98d3-701031bba09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:10.616058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b959b8-132f-4a9d-98d3-701031bba09d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:10.625840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 323/628] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:10.627571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977cac9-4711-4613-9353-49cea200785b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.627974 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977cac9-4711-4613-9353-49cea200785b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.628366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977cac9-4711-4613-9353-49cea200785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.643436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b7656-b40c-43ac-82e6-ea024a52b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:10.644398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7656-b40c-43ac-82e6-ea024a52b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.644885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7656-b40c-43ac-82e6-ea024a52b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.645404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7656-b40c-43ac-82e6-ea024a52b2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.646557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b7656-b40c-43ac-82e6-ea024a52b2d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:10.647433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b7656-b40c-43ac-82e6-ea024a52b2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:10.649394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-2977cac9-4711-4613-9353-49cea200785b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:10.650519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b7656-b40c-43ac-82e6-ea024a52b2d0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:10.650863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-2977cac9-4711-4613-9353-49cea200785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:10.667113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 306/629] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:10.668291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b7656-b40c-43ac-82e6-ea024a52b2d0 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:10.728358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 324/630] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:10.729464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977cac9-4711-4613-9353-49cea200785b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:10.740627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:10.743557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:10.785985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b7656-b40c-43ac-82e6-ea024a52b2d0 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:10.839711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67588-c34a-4f93-8b16-c0ef9cc3fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:10.840856 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67588-c34a-4f93-8b16-c0ef9cc3fff1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.841386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67588-c34a-4f93-8b16-c0ef9cc3fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.841975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67588-c34a-4f93-8b16-c0ef9cc3fff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.854015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977cac9-4711-4613-9353-49cea200785b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:10.872187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e67588-c34a-4f93-8b16-c0ef9cc3fff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:10.874128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e67588-c34a-4f93-8b16-c0ef9cc3fff1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:10.892285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe77aa-7bc2-4dd6-b917-9e5ea98e2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:10.892792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe77aa-7bc2-4dd6-b917-9e5ea98e2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:10.893079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe77aa-7bc2-4dd6-b917-9e5ea98e2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:10.893355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe77aa-7bc2-4dd6-b917-9e5ea98e2fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-41e67588-c34a-4f93-8b16-c0ef9cc3fff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:10.899812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:10.900865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:10.901869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:10.901869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:10.901869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:10.910792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe77aa-7bc2-4dd6-b917-9e5ea98e2fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:10.910792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe77aa-7bc2-4dd6-b917-9e5ea98e2fc8 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:10.912713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 307/631] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:10.917897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67588-c34a-4f93-8b16-c0ef9cc3fff1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-60fe77aa-7bc2-4dd6-b917-9e5ea98e2fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:10.923273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:10.924218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:10.925095 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:10.925095 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:10.925095 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:10.938791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 325/632] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:10.943199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe77aa-7bc2-4dd6-b917-9e5ea98e2fc8 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:11.033513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:11.054422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67588-c34a-4f93-8b16-c0ef9cc3fff1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:11.066117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe77aa-7bc2-4dd6-b917-9e5ea98e2fc8 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:11.069064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:11.092363 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928583b-a0b3-4e6c-97fd-7c7e00d3f50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:11.092953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928583b-a0b3-4e6c-97fd-7c7e00d3f50b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.093236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928583b-a0b3-4e6c-97fd-7c7e00d3f50b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.093511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928583b-a0b3-4e6c-97fd-7c7e00d3f50b None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.094298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928583b-a0b3-4e6c-97fd-7c7e00d3f50b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:11.094602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928583b-a0b3-4e6c-97fd-7c7e00d3f50b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:11.096014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928583b-a0b3-4e6c-97fd-7c7e00d3f50b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:11.105036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9002e8-7600-4bcb-9e5d-e33d6ac007de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:11.105753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9002e8-7600-4bcb-9e5d-e33d6ac007de None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.106103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9002e8-7600-4bcb-9e5d-e33d6ac007de None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.106526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9002e8-7600-4bcb-9e5d-e33d6ac007de None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.107189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9002e8-7600-4bcb-9e5d-e33d6ac007de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:11.107575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9002e8-7600-4bcb-9e5d-e33d6ac007de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:11.113584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 308/633] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:11.113734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9002e8-7600-4bcb-9e5d-e33d6ac007de None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:11.113831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa020fb-8dbd-4b4d-82d9-37ce3dc36ed1 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.113831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa020fb-8dbd-4b4d-82d9-37ce3dc36ed1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.113831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa020fb-8dbd-4b4d-82d9-37ce3dc36ed1 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.113831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 309/634] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:11.113831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa020fb-8dbd-4b4d-82d9-37ce3dc36ed1 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:11.128795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 326/635] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:11.129716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9002e8-7600-4bcb-9e5d-e33d6ac007de None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:11.232425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa020fb-8dbd-4b4d-82d9-37ce3dc36ed1 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:11.238340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9002e8-7600-4bcb-9e5d-e33d6ac007de None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:11.250185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:11.276446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc6fc5-e18c-4bf6-88f0-ed7cd9f89d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:11.277095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc6fc5-e18c-4bf6-88f0-ed7cd9f89d4c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.277375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc6fc5-e18c-4bf6-88f0-ed7cd9f89d4c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.277651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc6fc5-e18c-4bf6-88f0-ed7cd9f89d4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.280697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63ce0d-fa87-4288-9e24-f4c48dd3a164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:11.281175 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63ce0d-fa87-4288-9e24-f4c48dd3a164 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.282202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63ce0d-fa87-4288-9e24-f4c48dd3a164 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.282502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63ce0d-fa87-4288-9e24-f4c48dd3a164 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.290585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63ce0d-fa87-4288-9e24-f4c48dd3a164 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:11.291123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc6fc5-e18c-4bf6-88f0-ed7cd9f89d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:11.292310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63ce0d-fa87-4288-9e24-f4c48dd3a164 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-29bc6fc5-e18c-4bf6-88f0-ed7cd9f89d4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:11.296789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:11.305209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 310/636] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:11.306868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6676c70-8d17-41c2-a8b8-4c2815fb3b3f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.308655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6676c70-8d17-41c2-a8b8-4c2815fb3b3f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.308655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6676c70-8d17-41c2-a8b8-4c2815fb3b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-6b63ce0d-fa87-4288-9e24-f4c48dd3a164 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:11.308903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:11.310793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:11.313467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:11.314933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 327/637] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 11:33:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:11.315064 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63ce0d-fa87-4288-9e24-f4c48dd3a164 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:11.327333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d6676c70-8d17-41c2-a8b8-4c2815fb3b3f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:11.329309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d6676c70-8d17-41c2-a8b8-4c2815fb3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:11.374609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:11.430941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 311/638] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:11.432252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6676c70-8d17-41c2-a8b8-4c2815fb3b3f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:11.458892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63ce0d-fa87-4288-9e24-f4c48dd3a164 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:11.517336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cab80-c8bc-4f42-a37b-66947ee65f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:11.518120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cab80-c8bc-4f42-a37b-66947ee65f3f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.518542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cab80-c8bc-4f42-a37b-66947ee65f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.519044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cab80-c8bc-4f42-a37b-66947ee65f3f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.532427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cab80-c8bc-4f42-a37b-66947ee65f3f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:11.534158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cab80-c8bc-4f42-a37b-66947ee65f3f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-848cab80-c8bc-4f42-a37b-66947ee65f3f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:11.548769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:11.549823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:33:11.550743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:11.554574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 328/639] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:11.555472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cab80-c8bc-4f42-a37b-66947ee65f3f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:11.594266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:11.629809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6676c70-8d17-41c2-a8b8-4c2815fb3b3f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:11.671286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cab80-c8bc-4f42-a37b-66947ee65f3f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:11.712851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c957e5-5491-48d0-b0e3-1a7f83926644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:11.713224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad848a-1e4d-43ed-bf9c-2cec78400bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:11.718848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c957e5-5491-48d0-b0e3-1a7f83926644 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.719122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad848a-1e4d-43ed-bf9c-2cec78400bcf None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.719284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c957e5-5491-48d0-b0e3-1a7f83926644 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.719439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad848a-1e4d-43ed-bf9c-2cec78400bcf None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.719609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c957e5-5491-48d0-b0e3-1a7f83926644 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.719770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad848a-1e4d-43ed-bf9c-2cec78400bcf None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.719770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad848a-1e4d-43ed-bf9c-2cec78400bcf None admin] RBAC: Adding query filter params (name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:11.720047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c957e5-5491-48d0-b0e3-1a7f83926644 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:11.720189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad848a-1e4d-43ed-bf9c-2cec78400bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:11.720353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c957e5-5491-48d0-b0e3-1a7f83926644 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:11.720512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad848a-1e4d-43ed-bf9c-2cec78400bcf None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:11.720669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c957e5-5491-48d0-b0e3-1a7f83926644 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:11.732301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 312/640] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:11.733708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad848a-1e4d-43ed-bf9c-2cec78400bcf None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:11.756453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 329/641] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 11:33:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:11.756453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c957e5-5491-48d0-b0e3-1a7f83926644 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:11.772035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:11.867763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad848a-1e4d-43ed-bf9c-2cec78400bcf None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:11.868437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:11.887472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c957e5-5491-48d0-b0e3-1a7f83926644 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:11.912456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b2687-227e-4234-a884-bdad4852fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:11.913367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b2687-227e-4234-a884-bdad4852fac7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.913804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b2687-227e-4234-a884-bdad4852fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.914268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b2687-227e-4234-a884-bdad4852fac7 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.915172 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b2687-227e-4234-a884-bdad4852fac7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:11.915651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b2687-227e-4234-a884-bdad4852fac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:11.917236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b2687-227e-4234-a884-bdad4852fac7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:11.935847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc3d7-ab5e-4673-8e63-3624740e7f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:11.937004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc3d7-ab5e-4673-8e63-3624740e7f3f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:11.937284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc3d7-ab5e-4673-8e63-3624740e7f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:11.940795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc3d7-ab5e-4673-8e63-3624740e7f3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:11.940934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 313/642] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 11:33:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:11.940934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b2687-227e-4234-a884-bdad4852fac7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:11.952271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbc3d7-ab5e-4673-8e63-3624740e7f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-39bbc3d7-ab5e-4673-8e63-3624740e7f3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:11.957710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:11.958730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 330/643] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:11.959627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc3d7-ab5e-4673-8e63-3624740e7f3f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:12.041524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:12.059290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b2687-227e-4234-a884-bdad4852fac7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:12.076434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc3d7-ab5e-4673-8e63-3624740e7f3f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:12.096414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed1045-7f69-4f9b-8c38-b0fb6081392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:12.097038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed1045-7f69-4f9b-8c38-b0fb6081392d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.097317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed1045-7f69-4f9b-8c38-b0fb6081392d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.097583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed1045-7f69-4f9b-8c38-b0fb6081392d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.108899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed1045-7f69-4f9b-8c38-b0fb6081392d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:12.110361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed1045-7f69-4f9b-8c38-b0fb6081392d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:12.112996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2e4c6-c367-4ceb-9a81-eb04dc457daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:12.113602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2e4c6-c367-4ceb-9a81-eb04dc457daf None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.113976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2e4c6-c367-4ceb-9a81-eb04dc457daf None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.114149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2e4c6-c367-4ceb-9a81-eb04dc457daf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-23ed1045-7f69-4f9b-8c38-b0fb6081392d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:12.124794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:12.126017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:12.127112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:12.127112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:12.127112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:12.127112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 314/644] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:12.127346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed1045-7f69-4f9b-8c38-b0fb6081392d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:12.138383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:12.195607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2e4c6-c367-4ceb-9a81-eb04dc457daf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:12.197329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2e4c6-c367-4ceb-9a81-eb04dc457daf None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:12.232967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed1045-7f69-4f9b-8c38-b0fb6081392d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:12.275501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7654e-2ee7-4a4a-a695-09d1531df9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:12.276383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7654e-2ee7-4a4a-a695-09d1531df9b7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.276658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7654e-2ee7-4a4a-a695-09d1531df9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.276940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7654e-2ee7-4a4a-a695-09d1531df9b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.282253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:12.328952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 331/645] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:12.328952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2e4c6-c367-4ceb-9a81-eb04dc457daf None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:12.366526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7654e-2ee7-4a4a-a695-09d1531df9b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:12.368000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7654e-2ee7-4a4a-a695-09d1531df9b7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:12.389369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:12.446903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2e4c6-c367-4ceb-9a81-eb04dc457daf None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:12.483794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 315/646] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:12.484803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7654e-2ee7-4a4a-a695-09d1531df9b7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:12.490139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b59d0-0b8a-40e0-89a8-33ba6494fa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:12.490784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b59d0-0b8a-40e0-89a8-33ba6494fa26 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.491065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b59d0-0b8a-40e0-89a8-33ba6494fa26 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.491359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b59d0-0b8a-40e0-89a8-33ba6494fa26 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.492031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b59d0-0b8a-40e0-89a8-33ba6494fa26 None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:12.492335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b59d0-0b8a-40e0-89a8-33ba6494fa26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:12.494177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b59d0-0b8a-40e0-89a8-33ba6494fa26 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:12.506637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 332/647] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:12.508451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b59d0-0b8a-40e0-89a8-33ba6494fa26 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:12.522450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:12.593501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7654e-2ee7-4a4a-a695-09d1531df9b7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:12.623397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b59d0-0b8a-40e0-89a8-33ba6494fa26 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:12.630740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fc0ca-212a-428a-85b6-fa4b2ca924c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:12.631376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fc0ca-212a-428a-85b6-fa4b2ca924c5 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.631652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fc0ca-212a-428a-85b6-fa4b2ca924c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.631923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fc0ca-212a-428a-85b6-fa4b2ca924c5 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.632594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fc0ca-212a-428a-85b6-fa4b2ca924c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:12.632893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fc0ca-212a-428a-85b6-fa4b2ca924c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:12.634257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fc0ca-212a-428a-85b6-fa4b2ca924c5 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:12.642885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:12.653789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 316/648] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:12.653789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fc0ca-212a-428a-85b6-fa4b2ca924c5 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:12.681039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd9f2b-a214-42a9-ad6e-c2463d2821d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:12.682020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd9f2b-a214-42a9-ad6e-c2463d2821d5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.682297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd9f2b-a214-42a9-ad6e-c2463d2821d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.682576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd9f2b-a214-42a9-ad6e-c2463d2821d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.696593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd9f2b-a214-42a9-ad6e-c2463d2821d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:12.698419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd9f2b-a214-42a9-ad6e-c2463d2821d5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-bbcd9f2b-a214-42a9-ad6e-c2463d2821d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:12.713303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:12.714390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:12.715435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:12.715435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:12.715435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:12.719493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 333/649] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:12.720131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd9f2b-a214-42a9-ad6e-c2463d2821d5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:12.759624 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:12.765984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fc0ca-212a-428a-85b6-fa4b2ca924c5 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:12.801473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20597-3a33-47a9-97f6-097fb90c42c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:12.802031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20597-3a33-47a9-97f6-097fb90c42c7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.802309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20597-3a33-47a9-97f6-097fb90c42c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.802582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20597-3a33-47a9-97f6-097fb90c42c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.814986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef20597-3a33-47a9-97f6-097fb90c42c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:12.816446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef20597-3a33-47a9-97f6-097fb90c42c7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:12.824356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd9f2b-a214-42a9-ad6e-c2463d2821d5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-bef20597-3a33-47a9-97f6-097fb90c42c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:12.830556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:12.831569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:12.832452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:12.832452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:12.832452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:12.833632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 317/650] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:12.834489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20597-3a33-47a9-97f6-097fb90c42c7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:12.863208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b402c-b97d-4c0d-badb-a2b8108be146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:12.863840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b402c-b97d-4c0d-badb-a2b8108be146 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.864119 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b402c-b97d-4c0d-badb-a2b8108be146 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.864435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b402c-b97d-4c0d-badb-a2b8108be146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.876168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b402c-b97d-4c0d-badb-a2b8108be146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:12.879212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b402c-b97d-4c0d-badb-a2b8108be146 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-be5b402c-b97d-4c0d-badb-a2b8108be146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:12.893278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:12.894469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:12.895426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:12.895426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:12.895426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:12.895426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 334/651] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:12.895686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688dea-9f5c-4ef9-9f7e-69c07fefbe18 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.896090 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688dea-9f5c-4ef9-9f7e-69c07fefbe18 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.896090 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688dea-9f5c-4ef9-9f7e-69c07fefbe18 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.897486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 335/652] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:12.899638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688dea-9f5c-4ef9-9f7e-69c07fefbe18 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:12.917110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:12.945607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20597-3a33-47a9-97f6-097fb90c42c7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:12.984074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad9233-5036-4226-831e-5ec74eb462bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:12.984807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad9233-5036-4226-831e-5ec74eb462bb None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:12.985363 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad9233-5036-4226-831e-5ec74eb462bb None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:12.985728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad9233-5036-4226-831e-5ec74eb462bb None admin] PATH_INFO: `/v3/users/glance` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:12.994940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad9233-5036-4226-831e-5ec74eb462bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:12.996385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad9233-5036-4226-831e-5ec74eb462bb None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.008473 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688dea-9f5c-4ef9-9f7e-69c07fefbe18 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-40ad9233-5036-4226-831e-5ec74eb462bb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:13.009055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:13.010333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 11:33:13.011413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:13.015721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 318/653] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:13.017557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad9233-5036-4226-831e-5ec74eb462bb None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.029133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:13.043947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68187907-9e53-4b14-870a-bf54955a60c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.044554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68187907-9e53-4b14-870a-bf54955a60c9 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.044837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68187907-9e53-4b14-870a-bf54955a60c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.045116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68187907-9e53-4b14-870a-bf54955a60c9 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.045763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68187907-9e53-4b14-870a-bf54955a60c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:13.046069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68187907-9e53-4b14-870a-bf54955a60c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:13.047578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68187907-9e53-4b14-870a-bf54955a60c9 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.059282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 336/654] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:13.060100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68187907-9e53-4b14-870a-bf54955a60c9 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.124526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad9233-5036-4226-831e-5ec74eb462bb None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.144847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:13.159699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9882c-5351-448b-bcc1-3ce8a4466ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.160300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9882c-5351-448b-bcc1-3ce8a4466ab5 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.160622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9882c-5351-448b-bcc1-3ce8a4466ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.160923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9882c-5351-448b-bcc1-3ce8a4466ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.161543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9882c-5351-448b-bcc1-3ce8a4466ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:13.161838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9882c-5351-448b-bcc1-3ce8a4466ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:13.163269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9882c-5351-448b-bcc1-3ce8a4466ab5 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.172354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68187907-9e53-4b14-870a-bf54955a60c9 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.175308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 319/655] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:13.176644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2f3c2-03c4-4728-bb8f-8fc726a71b7f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.176958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2f3c2-03c4-4728-bb8f-8fc726a71b7f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.177266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2f3c2-03c4-4728-bb8f-8fc726a71b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.197245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3fe2f3c2-03c4-4728-bb8f-8fc726a71b7f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:13.198473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3fe2f3c2-03c4-4728-bb8f-8fc726a71b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:13.214419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcdb26-a2a9-4a54-8f22-aa451c157235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.215120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcdb26-a2a9-4a54-8f22-aa451c157235 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.215420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcdb26-a2a9-4a54-8f22-aa451c157235 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.215733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcdb26-a2a9-4a54-8f22-aa451c157235 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.216449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcdb26-a2a9-4a54-8f22-aa451c157235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:13.216788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcdb26-a2a9-4a54-8f22-aa451c157235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:13.218316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcdb26-a2a9-4a54-8f22-aa451c157235 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.231148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 337/656] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:13.231999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcdb26-a2a9-4a54-8f22-aa451c157235 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.263729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:13.270171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 320/657] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:13.271103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2f3c2-03c4-4728-bb8f-8fc726a71b7f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.338047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcdb26-a2a9-4a54-8f22-aa451c157235 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.374910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1482b8-5138-4cc6-8971-59766d2fd2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.376337 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1482b8-5138-4cc6-8971-59766d2fd2f5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.376691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1482b8-5138-4cc6-8971-59766d2fd2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.376999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1482b8-5138-4cc6-8971-59766d2fd2f5 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.377774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1482b8-5138-4cc6-8971-59766d2fd2f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:13.378122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1482b8-5138-4cc6-8971-59766d2fd2f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:13.378796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2f3c2-03c4-4728-bb8f-8fc726a71b7f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.379729 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1482b8-5138-4cc6-8971-59766d2fd2f5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.381617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:13.401048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 338/658] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:13.402244 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1482b8-5138-4cc6-8971-59766d2fd2f5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.424574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1a84-6f86-4498-89d5-803b4d2a1c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.425302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1a84-6f86-4498-89d5-803b4d2a1c61 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.425587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1a84-6f86-4498-89d5-803b4d2a1c61 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.425931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1a84-6f86-4498-89d5-803b4d2a1c61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.434441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1a84-6f86-4498-89d5-803b4d2a1c61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:13.436033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1a84-6f86-4498-89d5-803b4d2a1c61 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-51cd1a84-6f86-4498-89d5-803b4d2a1c61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:13.448875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:13.449817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 321/659] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:13.450822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1a84-6f86-4498-89d5-803b4d2a1c61 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.517656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:13.522308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1482b8-5138-4cc6-8971-59766d2fd2f5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.559407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bae1f6-e093-409a-8f35-3840cbfd72d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.560317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bae1f6-e093-409a-8f35-3840cbfd72d4 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.560690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bae1f6-e093-409a-8f35-3840cbfd72d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.561086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bae1f6-e093-409a-8f35-3840cbfd72d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.567756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1a84-6f86-4498-89d5-803b4d2a1c61 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.569756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bae1f6-e093-409a-8f35-3840cbfd72d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:13.571256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bae1f6-e093-409a-8f35-3840cbfd72d4 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-29bae1f6-e093-409a-8f35-3840cbfd72d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:13.582706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:13.583826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 339/660] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:13.585060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bae1f6-e093-409a-8f35-3840cbfd72d4 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.608093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c4b56-8cf2-4271-89dd-3a1ca30ef234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.608802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c4b56-8cf2-4271-89dd-3a1ca30ef234 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.609087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c4b56-8cf2-4271-89dd-3a1ca30ef234 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.609942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c4b56-8cf2-4271-89dd-3a1ca30ef234 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.617473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c4b56-8cf2-4271-89dd-3a1ca30ef234 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:13.618941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c4b56-8cf2-4271-89dd-3a1ca30ef234 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-626c4b56-8cf2-4271-89dd-3a1ca30ef234 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:13.631129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:13.632216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 322/661] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:13.633213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c4b56-8cf2-4271-89dd-3a1ca30ef234 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.643268 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:13.694325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bae1f6-e093-409a-8f35-3840cbfd72d4 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.727985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507cb23-c8d4-42d4-83d0-9700b9745378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.728585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507cb23-c8d4-42d4-83d0-9700b9745378 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.728862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507cb23-c8d4-42d4-83d0-9700b9745378 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.729134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507cb23-c8d4-42d4-83d0-9700b9745378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.735412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c4b56-8cf2-4271-89dd-3a1ca30ef234 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.752821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:13.770626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a273-08d5-43fe-8056-a03b4c8ece9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.771273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a273-08d5-43fe-8056-a03b4c8ece9d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.771555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a273-08d5-43fe-8056-a03b4c8ece9d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.771825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a273-08d5-43fe-8056-a03b4c8ece9d None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.772511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a273-08d5-43fe-8056-a03b4c8ece9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:13.772812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a273-08d5-43fe-8056-a03b4c8ece9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:13.774224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a273-08d5-43fe-8056-a03b4c8ece9d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.786952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 323/662] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:13.787756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a273-08d5-43fe-8056-a03b4c8ece9d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.799702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507cb23-c8d4-42d4-83d0-9700b9745378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:13.801344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507cb23-c8d4-42d4-83d0-9700b9745378 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:13.857233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:13.890573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a273-08d5-43fe-8056-a03b4c8ece9d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:13.911808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 340/663] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:13.912901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507cb23-c8d4-42d4-83d0-9700b9745378 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.927590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe1ba-922b-41fc-8e82-8495d9b25e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:13.928161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe1ba-922b-41fc-8e82-8495d9b25e0e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:13.928436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe1ba-922b-41fc-8e82-8495d9b25e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:13.928709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe1ba-922b-41fc-8e82-8495d9b25e0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:13.939318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfe1ba-922b-41fc-8e82-8495d9b25e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-0acfe1ba-922b-41fc-8e82-8495d9b25e0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:13.944012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:13.945308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 324/664] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:13.946606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe1ba-922b-41fc-8e82-8495d9b25e0e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:13.992418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:14.030855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507cb23-c8d4-42d4-83d0-9700b9745378 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:14.062874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe1ba-922b-41fc-8e82-8495d9b25e0e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:14.066041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959aabd-9ecc-488b-bdf0-ccaf9d640146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:14.066643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959aabd-9ecc-488b-bdf0-ccaf9d640146 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:14.066952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959aabd-9ecc-488b-bdf0-ccaf9d640146 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:14.067223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959aabd-9ecc-488b-bdf0-ccaf9d640146 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:14.067910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959aabd-9ecc-488b-bdf0-ccaf9d640146 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:14.068215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959aabd-9ecc-488b-bdf0-ccaf9d640146 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:14.069716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959aabd-9ecc-488b-bdf0-ccaf9d640146 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:14.081669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 341/665] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:14.082475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959aabd-9ecc-488b-bdf0-ccaf9d640146 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:14.098177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:14.101902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae513e3-0de8-4707-b2dc-8a730672344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:14.102574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae513e3-0de8-4707-b2dc-8a730672344f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:14.102964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae513e3-0de8-4707-b2dc-8a730672344f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:14.103304 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae513e3-0de8-4707-b2dc-8a730672344f None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:14.104106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae513e3-0de8-4707-b2dc-8a730672344f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:14.104487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae513e3-0de8-4707-b2dc-8a730672344f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:14.106169 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae513e3-0de8-4707-b2dc-8a730672344f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:14.128239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 325/666] 10.222.0.59 () {56 vars in 1139 bytes} [Wed Aug 24 11:33:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:14.129168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae513e3-0de8-4707-b2dc-8a730672344f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:14.196791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959aabd-9ecc-488b-bdf0-ccaf9d640146 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:14.226743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:14.231962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447eab4-2d0d-4589-889f-081df5930de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:14.232620 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447eab4-2d0d-4589-889f-081df5930de1 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:14.232958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447eab4-2d0d-4589-889f-081df5930de1 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:14.233223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae513e3-0de8-4707-b2dc-8a730672344f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:14.233325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447eab4-2d0d-4589-889f-081df5930de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:14.234072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447eab4-2d0d-4589-889f-081df5930de1 None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=46e2fac1066d4ad7b670d46f158fec97) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:14.234481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447eab4-2d0d-4589-889f-081df5930de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:14.236632 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447eab4-2d0d-4589-889f-081df5930de1 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:14.242522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 342/667] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:14 2022] GET /identity/v3/role_assignments?user.id=46e2fac1066d4ad7b670d46f158fec97&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:14.243404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447eab4-2d0d-4589-889f-081df5930de1 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:14.271147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927679d1-1158-41be-9ba9-752252af4cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:14.271804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927679d1-1158-41be-9ba9-752252af4cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:14.272084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927679d1-1158-41be-9ba9-752252af4cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:14.272358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927679d1-1158-41be-9ba9-752252af4cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:14.285120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927679d1-1158-41be-9ba9-752252af4cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:14.286625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927679d1-1158-41be-9ba9-752252af4cb9 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-927679d1-1158-41be-9ba9-752252af4cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:14.304602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:14.305632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:14.306532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:14.306532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:14.306532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:14.306532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 326/668] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:14.306814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927679d1-1158-41be-9ba9-752252af4cb9 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:14.355221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:14.383381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447eab4-2d0d-4589-889f-081df5930de1 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:14.425296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19ff26-b55d-4858-bc19-0cdb29475e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:14.425918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19ff26-b55d-4858-bc19-0cdb29475e88 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:14.426202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19ff26-b55d-4858-bc19-0cdb29475e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:14.426476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19ff26-b55d-4858-bc19-0cdb29475e88 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:14.427210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19ff26-b55d-4858-bc19-0cdb29475e88 None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:14.427514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19ff26-b55d-4858-bc19-0cdb29475e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:14.428888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19ff26-b55d-4858-bc19-0cdb29475e88 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:14.432129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927679d1-1158-41be-9ba9-752252af4cb9 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:14.437992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 343/669] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:14.439175 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19ff26-b55d-4858-bc19-0cdb29475e88 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:14.474708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcdb3b-6215-4d59-8a4b-4d985e978d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:14.475305 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcdb3b-6215-4d59-8a4b-4d985e978d1b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:14.475580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcdb3b-6215-4d59-8a4b-4d985e978d1b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:14.476135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcdb3b-6215-4d59-8a4b-4d985e978d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:14.476648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcdb3b-6215-4d59-8a4b-4d985e978d1b None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=580a07e04f3e42a5bb2801e583a78a1c) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:14.476957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcdb3b-6215-4d59-8a4b-4d985e978d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:14.478501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcdb3b-6215-4d59-8a4b-4d985e978d1b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:14.485309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 327/670] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:14 2022] GET /identity/v3/role_assignments?user.id=580a07e04f3e42a5bb2801e583a78a1c&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:14.486060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcdb3b-6215-4d59-8a4b-4d985e978d1b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:14.508822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:14.571784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19ff26-b55d-4858-bc19-0cdb29475e88 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:14.622260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269631-e0cc-410f-9306-75a1b431d735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:14.623174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269631-e0cc-410f-9306-75a1b431d735 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:14.623572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269631-e0cc-410f-9306-75a1b431d735 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:14.623976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269631-e0cc-410f-9306-75a1b431d735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:14.635789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:14.648285 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcdb3b-6215-4d59-8a4b-4d985e978d1b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:14.697321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef2ee8-a0dd-461a-b965-d9b3cfd56c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:14.698638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef2ee8-a0dd-461a-b965-d9b3cfd56c56 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:14.698964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef2ee8-a0dd-461a-b965-d9b3cfd56c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:14.699812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef2ee8-a0dd-461a-b965-d9b3cfd56c56 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:14.700038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef2ee8-a0dd-461a-b965-d9b3cfd56c56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:14.700385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef2ee8-a0dd-461a-b965-d9b3cfd56c56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:14.702199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef2ee8-a0dd-461a-b965-d9b3cfd56c56 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:14.715571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b269631-e0cc-410f-9306-75a1b431d735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:14.717377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 328/671] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:14.718303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef2ee8-a0dd-461a-b965-d9b3cfd56c56 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:14.718480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b269631-e0cc-410f-9306-75a1b431d735 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:14.798368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:14.825526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef2ee8-a0dd-461a-b965-d9b3cfd56c56 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:14.836355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 344/672] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:14.837238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269631-e0cc-410f-9306-75a1b431d735 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:14.880001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe34fb5-2c40-4656-9b37-cc8be3635d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:14.881145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe34fb5-2c40-4656-9b37-cc8be3635d1a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:14.881608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe34fb5-2c40-4656-9b37-cc8be3635d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:14.882076 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe34fb5-2c40-4656-9b37-cc8be3635d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:14.901627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe34fb5-2c40-4656-9b37-cc8be3635d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:14.902263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:14.905518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe34fb5-2c40-4656-9b37-cc8be3635d1a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-efe34fb5-2c40-4656-9b37-cc8be3635d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:14.934001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:14.935050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:14.935989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:14.935989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:14.935989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:14.935989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 329/673] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:14.935989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe34fb5-2c40-4656-9b37-cc8be3635d1a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:14.978971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269631-e0cc-410f-9306-75a1b431d735 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:15.018221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d76056-f049-43a5-b2d2-2b7d46f11664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:15.018943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d76056-f049-43a5-b2d2-2b7d46f11664 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:15.019227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d76056-f049-43a5-b2d2-2b7d46f11664 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:15.019499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d76056-f049-43a5-b2d2-2b7d46f11664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:15.026639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d76056-f049-43a5-b2d2-2b7d46f11664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:15.028135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d76056-f049-43a5-b2d2-2b7d46f11664 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-48d76056-f049-43a5-b2d2-2b7d46f11664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:15.040596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:15.042605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 345/674] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:15.044682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d76056-f049-43a5-b2d2-2b7d46f11664 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:15.050289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe34fb5-2c40-4656-9b37-cc8be3635d1a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:15.077595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:15.089697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62ac27-bdfc-47ad-bc54-167050fc9140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:15.090680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62ac27-bdfc-47ad-bc54-167050fc9140 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:15.091344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62ac27-bdfc-47ad-bc54-167050fc9140 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:15.091808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62ac27-bdfc-47ad-bc54-167050fc9140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:15.103749 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62ac27-bdfc-47ad-bc54-167050fc9140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:15.105539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62ac27-bdfc-47ad-bc54-167050fc9140 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-4b62ac27-bdfc-47ad-bc54-167050fc9140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:15.121052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:15.121998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:15.123344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:15.123344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:15.123344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:15.129390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 330/675] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:15.129390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62ac27-bdfc-47ad-bc54-167050fc9140 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:15.152819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:15.161293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d76056-f049-43a5-b2d2-2b7d46f11664 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:15.201035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5342c4-e16a-4a1f-95f1-e4878975a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:15.201651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5342c4-e16a-4a1f-95f1-e4878975a56b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:15.201931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5342c4-e16a-4a1f-95f1-e4878975a56b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:15.202203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5342c4-e16a-4a1f-95f1-e4878975a56b None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:15.202977 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5342c4-e16a-4a1f-95f1-e4878975a56b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:15.203799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5342c4-e16a-4a1f-95f1-e4878975a56b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:15.205193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5342c4-e16a-4a1f-95f1-e4878975a56b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:15.222837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 346/676] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:15.223758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5342c4-e16a-4a1f-95f1-e4878975a56b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:15.272488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62ac27-bdfc-47ad-bc54-167050fc9140 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:15.330876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caaffd-ff6e-4977-85c4-f45f5544c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:15.330876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caaffd-ff6e-4977-85c4-f45f5544c7ee None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:15.330876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caaffd-ff6e-4977-85c4-f45f5544c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:15.330876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caaffd-ff6e-4977-85c4-f45f5544c7ee None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:15.331275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caaffd-ff6e-4977-85c4-f45f5544c7ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:15.331275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caaffd-ff6e-4977-85c4-f45f5544c7ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:15.331660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caaffd-ff6e-4977-85c4-f45f5544c7ee None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:15.340752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5342c4-e16a-4a1f-95f1-e4878975a56b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:15.347420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 331/677] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:15.348403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caaffd-ff6e-4977-85c4-f45f5544c7ee None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:15.382097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6f953-887e-4138-b0cf-f847bf7ac4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:15.382877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6f953-887e-4138-b0cf-f847bf7ac4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:15.383167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6f953-887e-4138-b0cf-f847bf7ac4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:15.383442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6f953-887e-4138-b0cf-f847bf7ac4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:15.384101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6f953-887e-4138-b0cf-f847bf7ac4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:15.384707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6f953-887e-4138-b0cf-f847bf7ac4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:15.386657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6f953-887e-4138-b0cf-f847bf7ac4b3 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:15.389425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:15.402732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 347/678] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:15.404062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6f953-887e-4138-b0cf-f847bf7ac4b3 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:15.434683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:15.467533 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caaffd-ff6e-4977-85c4-f45f5544c7ee None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:15.507178 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1179d4-bf25-4855-a26d-e98b907e6a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:15.508577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1179d4-bf25-4855-a26d-e98b907e6a74 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:15.509222 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1179d4-bf25-4855-a26d-e98b907e6a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:15.509845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1179d4-bf25-4855-a26d-e98b907e6a74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:15.519801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1179d4-bf25-4855-a26d-e98b907e6a74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:15.521472 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1179d4-bf25-4855-a26d-e98b907e6a74 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-ae1179d4-bf25-4855-a26d-e98b907e6a74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:15.534065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:15.535067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:15.536061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:15.538733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 332/679] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:15.539756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1179d4-bf25-4855-a26d-e98b907e6a74 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:15.541832 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6f953-887e-4138-b0cf-f847bf7ac4b3 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:15.586890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0a89d-11d0-4b3d-8e00-f2488487ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:15.587536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0a89d-11d0-4b3d-8e00-f2488487ff76 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:15.587771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0a89d-11d0-4b3d-8e00-f2488487ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:15.587960 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0a89d-11d0-4b3d-8e00-f2488487ff76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:15.588715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0a89d-11d0-4b3d-8e00-f2488487ff76 None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=bd3bd33cac7d4715bede59def04cdb92) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:15.589010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0a89d-11d0-4b3d-8e00-f2488487ff76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:15.590700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0a89d-11d0-4b3d-8e00-f2488487ff76 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:15.599558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 348/680] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:15 2022] GET /identity/v3/role_assignments?user.id=bd3bd33cac7d4715bede59def04cdb92&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:15.600934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0a89d-11d0-4b3d-8e00-f2488487ff76 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:15.738842 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:15.748000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1179d4-bf25-4855-a26d-e98b907e6a74 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:15.767144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:15.800615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0a89d-11d0-4b3d-8e00-f2488487ff76 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:15.822598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264197d-3caf-4c55-82e6-5186e9cb8fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:15.823309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264197d-3caf-4c55-82e6-5186e9cb8fb6 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:15.823594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264197d-3caf-4c55-82e6-5186e9cb8fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:15.823865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264197d-3caf-4c55-82e6-5186e9cb8fb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:15.834623 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264197d-3caf-4c55-82e6-5186e9cb8fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:15.836134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264197d-3caf-4c55-82e6-5186e9cb8fb6 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:15.855092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1207a-e097-438e-8de1-1f7282d6e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-0264197d-3caf-4c55-82e6-5186e9cb8fb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:15.855296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:15.856251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:15.857886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:15.857886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:15.857886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:15.857886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:15.857886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:15.857886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:15.857886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:15.857886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:15.858324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1207a-e097-438e-8de1-1f7282d6e925 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:15.858324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1207a-e097-438e-8de1-1f7282d6e925 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:15.858324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1207a-e097-438e-8de1-1f7282d6e925 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:15.858515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 333/681] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:15.858583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1207a-e097-438e-8de1-1f7282d6e925 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:15.858583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1207a-e097-438e-8de1-1f7282d6e925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:15.859319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1207a-e097-438e-8de1-1f7282d6e925 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:15.865914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264197d-3caf-4c55-82e6-5186e9cb8fb6 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:15.899416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 349/682] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 11:33:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:15.900868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1207a-e097-438e-8de1-1f7282d6e925 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.071553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264197d-3caf-4c55-82e6-5186e9cb8fb6 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.080701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1207a-e097-438e-8de1-1f7282d6e925 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.125562 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c125-d3ce-4cf9-8c5a-c4b60e617d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.126188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c125-d3ce-4cf9-8c5a-c4b60e617d56 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.126472 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c125-d3ce-4cf9-8c5a-c4b60e617d56 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.126742 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c125-d3ce-4cf9-8c5a-c4b60e617d56 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.127781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449c125-d3ce-4cf9-8c5a-c4b60e617d56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:16.128089 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449c125-d3ce-4cf9-8c5a-c4b60e617d56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.129535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449c125-d3ce-4cf9-8c5a-c4b60e617d56 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.137150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925a907-615e-4b55-9819-48d404f9204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.137766 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925a907-615e-4b55-9819-48d404f9204f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.138039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925a907-615e-4b55-9819-48d404f9204f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.138924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925a907-615e-4b55-9819-48d404f9204f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.145162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 334/683] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:16.153188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.156995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c125-d3ce-4cf9-8c5a-c4b60e617d56 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.185145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.235918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925a907-615e-4b55-9819-48d404f9204f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.237531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925a907-615e-4b55-9819-48d404f9204f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.349557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c125-d3ce-4cf9-8c5a-c4b60e617d56 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.390408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 350/684] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:16.402096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e40153-8e41-4aa4-be2a-3f2f886a995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.403104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40153-8e41-4aa4-be2a-3f2f886a995a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.403495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925a907-615e-4b55-9819-48d404f9204f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.405927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40153-8e41-4aa4-be2a-3f2f886a995a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.407024 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40153-8e41-4aa4-be2a-3f2f886a995a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.407983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40153-8e41-4aa4-be2a-3f2f886a995a None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=9b072d5669e34ad5b7b52a4a6e26700b) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:16.409646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40153-8e41-4aa4-be2a-3f2f886a995a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.411344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40153-8e41-4aa4-be2a-3f2f886a995a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.431589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 335/685] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:16 2022] GET /identity/v3/role_assignments?user.id=9b072d5669e34ad5b7b52a4a6e26700b&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:16.470560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.496378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac4fa2-11c9-48ef-a63f-52524628df98 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.496728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac4fa2-11c9-48ef-a63f-52524628df98 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.496969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac4fa2-11c9-48ef-a63f-52524628df98 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.500195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 336/686] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:16.506371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3cc1a-8eeb-464a-91c9-4e7823e62a1e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.506675 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3cc1a-8eeb-464a-91c9-4e7823e62a1e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.506961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3cc1a-8eeb-464a-91c9-4e7823e62a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.551954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-85f3cc1a-8eeb-464a-91c9-4e7823e62a1e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.553200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-85f3cc1a-8eeb-464a-91c9-4e7823e62a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:16.555055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925a907-615e-4b55-9819-48d404f9204f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.620014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef56d04-3e26-48a8-9ae3-d732724d1c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.620792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef56d04-3e26-48a8-9ae3-d732724d1c79 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.620986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef56d04-3e26-48a8-9ae3-d732724d1c79 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.621242 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef56d04-3e26-48a8-9ae3-d732724d1c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.644717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef56d04-3e26-48a8-9ae3-d732724d1c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.646117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef56d04-3e26-48a8-9ae3-d732724d1c79 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-bef56d04-3e26-48a8-9ae3-d732724d1c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:16.669595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:16.671113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:16.672787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:16.672787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:16.672787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:16.677225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 351/687] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:16.678261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef56d04-3e26-48a8-9ae3-d732724d1c79 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.692010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 337/688] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:16.789704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.800249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef56d04-3e26-48a8-9ae3-d732724d1c79 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:16.857689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301d997-c0ef-4f57-956e-1cd6faa6cf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:16.858329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d997-c0ef-4f57-956e-1cd6faa6cf30 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.858610 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d997-c0ef-4f57-956e-1cd6faa6cf30 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.858908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d997-c0ef-4f57-956e-1cd6faa6cf30 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.859657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d997-c0ef-4f57-956e-1cd6faa6cf30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:16.859982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d997-c0ef-4f57-956e-1cd6faa6cf30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:16.861429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d997-c0ef-4f57-956e-1cd6faa6cf30 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:16.877852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 352/689] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:16.883147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3cc1a-8eeb-464a-91c9-4e7823e62a1e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:16.903561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65439e2e-f531-44ea-851e-58e77932cc15 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.903736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:16.903818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65439e2e-f531-44ea-851e-58e77932cc15 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.903818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65439e2e-f531-44ea-851e-58e77932cc15 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.905266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 353/690] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:16.913670 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c276-1be8-4053-a49b-5824a6f02ed3 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:16.913970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c276-1be8-4053-a49b-5824a6f02ed3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:16.914224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c276-1be8-4053-a49b-5824a6f02ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:16.946582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4f51c276-1be8-4053-a49b-5824a6f02ed3 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:16.948754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4f51c276-1be8-4053-a49b-5824a6f02ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:17.048694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3cc1a-8eeb-464a-91c9-4e7823e62a1e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.058959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 354/691] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:17.059890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c276-1be8-4053-a49b-5824a6f02ed3 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.109869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f2c61-b30b-42bd-844c-6d60230f88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.110542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f2c61-b30b-42bd-844c-6d60230f88ce None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.110835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f2c61-b30b-42bd-844c-6d60230f88ce None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.111141 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f2c61-b30b-42bd-844c-6d60230f88ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.128035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f2c61-b30b-42bd-844c-6d60230f88ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.129501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f2c61-b30b-42bd-844c-6d60230f88ce None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-1b7f2c61-b30b-42bd-844c-6d60230f88ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:17.156086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:17.157694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:17.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:17.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:17.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:17.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:17.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:17.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:17.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:17.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:17.158579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 338/692] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:17.164965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f2c61-b30b-42bd-844c-6d60230f88ce None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.202751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.224486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c276-1be8-4053-a49b-5824a6f02ed3 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.260663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6c20-2743-4edc-a12c-dd0a96ebfec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.261296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6c20-2743-4edc-a12c-dd0a96ebfec2 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.261677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6c20-2743-4edc-a12c-dd0a96ebfec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.261947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6c20-2743-4edc-a12c-dd0a96ebfec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.273704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6c20-2743-4edc-a12c-dd0a96ebfec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-1a3b6c20-2743-4edc-a12c-dd0a96ebfec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:17.283351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:17.285500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:17.287539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:17.293293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 355/693] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:17.293293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6c20-2743-4edc-a12c-dd0a96ebfec2 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.296035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.352259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f2c61-b30b-42bd-844c-6d60230f88ce None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.404147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f2f5e-0b57-4f63-b451-9e45138b6c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.404775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f2f5e-0b57-4f63-b451-9e45138b6c3b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.405056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f2f5e-0b57-4f63-b451-9e45138b6c3b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.405329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f2f5e-0b57-4f63-b451-9e45138b6c3b None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.406042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f2f5e-0b57-4f63-b451-9e45138b6c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:17.407065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f2f5e-0b57-4f63-b451-9e45138b6c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.408451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f2f5e-0b57-4f63-b451-9e45138b6c3b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.425201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 339/694] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:17.426096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f2f5e-0b57-4f63-b451-9e45138b6c3b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.439125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6c20-2743-4edc-a12c-dd0a96ebfec2 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.487837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a47015-431e-4121-8b3f-89172c97d6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.488492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a47015-431e-4121-8b3f-89172c97d6b1 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.488777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a47015-431e-4121-8b3f-89172c97d6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.489049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a47015-431e-4121-8b3f-89172c97d6b1 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.490360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a47015-431e-4121-8b3f-89172c97d6b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:17.490671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a47015-431e-4121-8b3f-89172c97d6b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.492493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a47015-431e-4121-8b3f-89172c97d6b1 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.505895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 356/695] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:17.506838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a47015-431e-4121-8b3f-89172c97d6b1 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.511932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.550991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f2f5e-0b57-4f63-b451-9e45138b6c3b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.584779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.593000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662b694-8975-4941-89d0-ef6242afe01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.594574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662b694-8975-4941-89d0-ef6242afe01d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.595142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662b694-8975-4941-89d0-ef6242afe01d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.595646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662b694-8975-4941-89d0-ef6242afe01d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.596512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662b694-8975-4941-89d0-ef6242afe01d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.598158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662b694-8975-4941-89d0-ef6242afe01d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-d662b694-8975-4941-89d0-ef6242afe01d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:17.611451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:17.612504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:33:17.613376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:17.615986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 340/696] 10.222.0.59 () {56 vars in 1129 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:17.617046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662b694-8975-4941-89d0-ef6242afe01d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.647216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a47015-431e-4121-8b3f-89172c97d6b1 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.685308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b11526-7adc-4dd6-a71c-c60d33ce7791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.685940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b11526-7adc-4dd6-a71c-c60d33ce7791 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.686149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b11526-7adc-4dd6-a71c-c60d33ce7791 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.686476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b11526-7adc-4dd6-a71c-c60d33ce7791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.687233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b11526-7adc-4dd6-a71c-c60d33ce7791 None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=d81a9aefdc6c4ada9baca8097927c03a) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:17.687718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b11526-7adc-4dd6-a71c-c60d33ce7791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.689339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b11526-7adc-4dd6-a71c-c60d33ce7791 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.696032 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 357/697] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/role_assignments?user.id=d81a9aefdc6c4ada9baca8097927c03a&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:17.696844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b11526-7adc-4dd6-a71c-c60d33ce7791 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.737383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662b694-8975-4941-89d0-ef6242afe01d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.780701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.805393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0163-aa5a-4892-9e3e-55ecb90e2016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.806051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0163-aa5a-4892-9e3e-55ecb90e2016 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.806441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0163-aa5a-4892-9e3e-55ecb90e2016 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.806715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0163-aa5a-4892-9e3e-55ecb90e2016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.824275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b11526-7adc-4dd6-a71c-c60d33ce7791 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:17.833549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0163-aa5a-4892-9e3e-55ecb90e2016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.835148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0163-aa5a-4892-9e3e-55ecb90e2016 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.864364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a58fd-98f5-4eb5-bc7f-6b9b50e4959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:17.864994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a58fd-98f5-4eb5-bc7f-6b9b50e4959f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:17.865373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a58fd-98f5-4eb5-bc7f-6b9b50e4959f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:17.865646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a58fd-98f5-4eb5-bc7f-6b9b50e4959f None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:17.866296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a58fd-98f5-4eb5-bc7f-6b9b50e4959f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:17.866596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a58fd-98f5-4eb5-bc7f-6b9b50e4959f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-b94f0163-aa5a-4892-9e3e-55ecb90e2016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:17.868142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:17.869079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:17.870394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:17.870394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:17.870394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:17.870564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a58fd-98f5-4eb5-bc7f-6b9b50e4959f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:17.870635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 341/698] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:17.877374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0163-aa5a-4892-9e3e-55ecb90e2016 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.878815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 358/699] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:17.884012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a58fd-98f5-4eb5-bc7f-6b9b50e4959f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:17.955846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.013274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a58fd-98f5-4eb5-bc7f-6b9b50e4959f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.028364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0163-aa5a-4892-9e3e-55ecb90e2016 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.044793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.050884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4862993-987c-45ac-a3a8-5fdcd4e30387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.051498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4862993-987c-45ac-a3a8-5fdcd4e30387 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.051775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4862993-987c-45ac-a3a8-5fdcd4e30387 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.052042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4862993-987c-45ac-a3a8-5fdcd4e30387 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.052672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4862993-987c-45ac-a3a8-5fdcd4e30387 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:18.052974 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4862993-987c-45ac-a3a8-5fdcd4e30387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.054358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4862993-987c-45ac-a3a8-5fdcd4e30387 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.061180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 359/700] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:18.080786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d27ac6-f26a-4bd8-b321-d821ff7060d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.081758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27ac6-f26a-4bd8-b321-d821ff7060d9 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.082213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27ac6-f26a-4bd8-b321-d821ff7060d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.082644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27ac6-f26a-4bd8-b321-d821ff7060d9 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.083665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d27ac6-f26a-4bd8-b321-d821ff7060d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:18.084139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d27ac6-f26a-4bd8-b321-d821ff7060d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.085952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d27ac6-f26a-4bd8-b321-d821ff7060d9 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.103012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 342/701] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:18.109860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4862993-987c-45ac-a3a8-5fdcd4e30387 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.243357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4862993-987c-45ac-a3a8-5fdcd4e30387 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.290083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3009b28-6e11-4386-9206-6b805c070fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.290725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3009b28-6e11-4386-9206-6b805c070fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.291024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3009b28-6e11-4386-9206-6b805c070fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.291306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3009b28-6e11-4386-9206-6b805c070fd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.303159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3009b28-6e11-4386-9206-6b805c070fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.304605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3009b28-6e11-4386-9206-6b805c070fd1 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-e3009b28-6e11-4386-9206-6b805c070fd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:18.321102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:18.322287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:18.323427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 360/702] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:18.331277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d27ac6-f26a-4bd8-b321-d821ff7060d9 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.471030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2164a3c-0632-4845-814f-121cc1c0ca3a None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.471420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2164a3c-0632-4845-814f-121cc1c0ca3a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.471599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2164a3c-0632-4845-814f-121cc1c0ca3a None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.473389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 361/703] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:18.476244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d27ac6-f26a-4bd8-b321-d821ff7060d9 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.479050 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88827b-8eae-462a-a3e5-28956c3e513b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.479330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88827b-8eae-462a-a3e5-28956c3e513b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.479605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88827b-8eae-462a-a3e5-28956c3e513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.486180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.523726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696f26-f5f4-4254-a315-3824025d74ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.524217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4f88827b-8eae-462a-a3e5-28956c3e513b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:18.524375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696f26-f5f4-4254-a315-3824025d74ab None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.524645 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696f26-f5f4-4254-a315-3824025d74ab None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.524975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696f26-f5f4-4254-a315-3824025d74ab None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.525834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696f26-f5f4-4254-a315-3824025d74ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:18.526242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696f26-f5f4-4254-a315-3824025d74ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.526502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4f88827b-8eae-462a-a3e5-28956c3e513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:18.528010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696f26-f5f4-4254-a315-3824025d74ab None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.552115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 343/704] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:18.558180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696f26-f5f4-4254-a315-3824025d74ab None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:18.636159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.681288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696f26-f5f4-4254-a315-3824025d74ab None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:18.697606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 362/705] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:18.726306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18974-51aa-4a7c-8805-e08cd87adeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:18.727109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18974-51aa-4a7c-8805-e08cd87adeae None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:18.727455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18974-51aa-4a7c-8805-e08cd87adeae None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:18.727804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18974-51aa-4a7c-8805-e08cd87adeae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:18.767629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:18.808536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da18974-51aa-4a7c-8805-e08cd87adeae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:18.809915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da18974-51aa-4a7c-8805-e08cd87adeae None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:18.930003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 344/706] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:18.935894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88827b-8eae-462a-a3e5-28956c3e513b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.048718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405e458-3200-427c-8745-0feea0cce5c2 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.049238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405e458-3200-427c-8745-0feea0cce5c2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.049647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405e458-3200-427c-8745-0feea0cce5c2 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.052744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 345/707] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:19.058105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78506a66-71cb-41c4-9b55-ca11f47f67c0 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.058393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78506a66-71cb-41c4-9b55-ca11f47f67c0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.058723 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78506a66-71cb-41c4-9b55-ca11f47f67c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.091963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-78506a66-71cb-41c4-9b55-ca11f47f67c0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:19.093173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-78506a66-71cb-41c4-9b55-ca11f47f67c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:19.118671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88827b-8eae-462a-a3e5-28956c3e513b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.174789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7da30e-e068-4778-906b-6bbafba37460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.175461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7da30e-e068-4778-906b-6bbafba37460 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.175971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7da30e-e068-4778-906b-6bbafba37460 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.176244 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7da30e-e068-4778-906b-6bbafba37460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.189956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.193490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7da30e-e068-4778-906b-6bbafba37460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.196796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7da30e-e068-4778-906b-6bbafba37460 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.200674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 346/708] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:19.201584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78506a66-71cb-41c4-9b55-ca11f47f67c0 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-db7da30e-e068-4778-906b-6bbafba37460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:19.227995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:19.228993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:19.229940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:19.229940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:19.229940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:19.229940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 363/709] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:19.237343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7da30e-e068-4778-906b-6bbafba37460 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.317963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.401749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7da30e-e068-4778-906b-6bbafba37460 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.428696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78506a66-71cb-41c4-9b55-ca11f47f67c0 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.439629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50de7-1bf9-4f4f-92af-5b9298dd61c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.440243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50de7-1bf9-4f4f-92af-5b9298dd61c4 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.440523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50de7-1bf9-4f4f-92af-5b9298dd61c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.440798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50de7-1bf9-4f4f-92af-5b9298dd61c4 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.441448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50de7-1bf9-4f4f-92af-5b9298dd61c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:19.441752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50de7-1bf9-4f4f-92af-5b9298dd61c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.443148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50de7-1bf9-4f4f-92af-5b9298dd61c4 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.456851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 364/710] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:19.461928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50de7-1bf9-4f4f-92af-5b9298dd61c4 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.510719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dafe1-c96b-4bc4-a69f-9e88fea28ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.511394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dafe1-c96b-4bc4-a69f-9e88fea28ca6 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.511674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dafe1-c96b-4bc4-a69f-9e88fea28ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.511943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dafe1-c96b-4bc4-a69f-9e88fea28ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.529887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dafe1-c96b-4bc4-a69f-9e88fea28ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.531575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dafe1-c96b-4bc4-a69f-9e88fea28ca6 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-453dafe1-c96b-4bc4-a69f-9e88fea28ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:19.551380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:19.552417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:19.553306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:19.553306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:19.553306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:19.558039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 347/711] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:19.559043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dafe1-c96b-4bc4-a69f-9e88fea28ca6 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.617550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.623908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50de7-1bf9-4f4f-92af-5b9298dd61c4 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.625815 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.681624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea34065-6ec8-45f1-b427-2a0857b2c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.682254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea34065-6ec8-45f1-b427-2a0857b2c631 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.682532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea34065-6ec8-45f1-b427-2a0857b2c631 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.682826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea34065-6ec8-45f1-b427-2a0857b2c631 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.690760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea34065-6ec8-45f1-b427-2a0857b2c631 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.692297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea34065-6ec8-45f1-b427-2a0857b2c631 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.693290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dafe1-c96b-4bc4-a69f-9e88fea28ca6 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-dea34065-6ec8-45f1-b427-2a0857b2c631 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:19.704256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:19.705523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:19.706402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:19.706402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:19.706402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:19.706402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:19.706402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:19.706402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:19.706402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:19.706402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:19.706402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 365/712] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:19.706931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea34065-6ec8-45f1-b427-2a0857b2c631 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.746340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2da32-25af-4460-aee6-67f66c43e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.747349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2da32-25af-4460-aee6-67f66c43e431 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.747857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2da32-25af-4460-aee6-67f66c43e431 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.748279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2da32-25af-4460-aee6-67f66c43e431 None admin] PATH_INFO: `/v3/services/network` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.749083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2da32-25af-4460-aee6-67f66c43e431 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.752024 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2da32-25af-4460-aee6-67f66c43e431 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-9ee2da32-25af-4460-aee6-67f66c43e431 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:19.765479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:19.767407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:33:19.768424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:19.776319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 348/713] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:19.776319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2da32-25af-4460-aee6-67f66c43e431 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.827002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea34065-6ec8-45f1-b427-2a0857b2c631 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.865545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503f3bc-2b5a-4147-9a8c-cdf2c2c77d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.866181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503f3bc-2b5a-4147-9a8c-cdf2c2c77d0e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.866459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503f3bc-2b5a-4147-9a8c-cdf2c2c77d0e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.866730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503f3bc-2b5a-4147-9a8c-cdf2c2c77d0e None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.867423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503f3bc-2b5a-4147-9a8c-cdf2c2c77d0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:19.867924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503f3bc-2b5a-4147-9a8c-cdf2c2c77d0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.869155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503f3bc-2b5a-4147-9a8c-cdf2c2c77d0e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.886731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 366/714] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:19.888405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503f3bc-2b5a-4147-9a8c-cdf2c2c77d0e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:19.913073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.919501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2da32-25af-4460-aee6-67f66c43e431 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:19.935925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.972617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eba38-c686-406d-ad06-e6b29ee7228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:19.973322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eba38-c686-406d-ad06-e6b29ee7228a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:19.973606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eba38-c686-406d-ad06-e6b29ee7228a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:19.973880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eba38-c686-406d-ad06-e6b29ee7228a None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:19.974827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eba38-c686-406d-ad06-e6b29ee7228a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:19.975079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eba38-c686-406d-ad06-e6b29ee7228a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:19.976664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eba38-c686-406d-ad06-e6b29ee7228a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:19.991928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 349/715] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:19.992780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eba38-c686-406d-ad06-e6b29ee7228a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.031289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503f3bc-2b5a-4147-9a8c-cdf2c2c77d0e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.071652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3beb91-ef5e-471f-b72f-c0f19dbe2725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.072271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3beb91-ef5e-471f-b72f-c0f19dbe2725 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.072554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3beb91-ef5e-471f-b72f-c0f19dbe2725 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.072829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3beb91-ef5e-471f-b72f-c0f19dbe2725 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.073472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3beb91-ef5e-471f-b72f-c0f19dbe2725 None admin] RBAC: Adding query filter params (name=network) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:20.073776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3beb91-ef5e-471f-b72f-c0f19dbe2725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.075182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3beb91-ef5e-471f-b72f-c0f19dbe2725 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.085539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 367/716] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:20.086879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3beb91-ef5e-471f-b72f-c0f19dbe2725 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.115050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eba38-c686-406d-ad06-e6b29ee7228a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.155638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3116a7f-c103-4e62-99d5-7905e1b2d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.156213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3116a7f-c103-4e62-99d5-7905e1b2d941 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.156654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3116a7f-c103-4e62-99d5-7905e1b2d941 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.157120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3116a7f-c103-4e62-99d5-7905e1b2d941 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.157777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3116a7f-c103-4e62-99d5-7905e1b2d941 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.159930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3116a7f-c103-4e62-99d5-7905e1b2d941 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.198907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 350/717] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:33:19 2022] POST /identity/v3/users => generated 254 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:20.198907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3116a7f-c103-4e62-99d5-7905e1b2d941 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.211432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:20.245706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3beb91-ef5e-471f-b72f-c0f19dbe2725 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.252818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:20.289518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acb947-68c0-4d3c-b3fe-ae41884517da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.290192 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb947-68c0-4d3c-b3fe-ae41884517da None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.290479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb947-68c0-4d3c-b3fe-ae41884517da None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.290756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb947-68c0-4d3c-b3fe-ae41884517da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.291683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acb947-68c0-4d3c-b3fe-ae41884517da None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=46e2fac1066d4ad7b670d46f158fec97) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:20.292000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acb947-68c0-4d3c-b3fe-ae41884517da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.293520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acb947-68c0-4d3c-b3fe-ae41884517da None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.300447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 368/718] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:20 2022] GET /identity/v3/role_assignments?user.id=46e2fac1066d4ad7b670d46f158fec97&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:20.301787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f318d-45c9-42f0-87c1-77375f47066d None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.302144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f318d-45c9-42f0-87c1-77375f47066d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.302424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f318d-45c9-42f0-87c1-77375f47066d None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.304249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 369/719] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:20.323879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45523-f1e2-4862-8482-99d3e303db50 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.324205 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45523-f1e2-4862-8482-99d3e303db50 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.324438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45523-f1e2-4862-8482-99d3e303db50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.347954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-19e45523-f1e2-4862-8482-99d3e303db50 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:20.353170 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-19e45523-f1e2-4862-8482-99d3e303db50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:20.382992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3116a7f-c103-4e62-99d5-7905e1b2d941 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.447266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4b412-47e4-4bef-8a1c-0f5c156a2da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.447818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4b412-47e4-4bef-8a1c-0f5c156a2da3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.448100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4b412-47e4-4bef-8a1c-0f5c156a2da3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.448377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4b412-47e4-4bef-8a1c-0f5c156a2da3 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.449032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4b412-47e4-4bef-8a1c-0f5c156a2da3 None admin] RBAC: Adding query filter params (type=network) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:20.449336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4b412-47e4-4bef-8a1c-0f5c156a2da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:20.450743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4b412-47e4-4bef-8a1c-0f5c156a2da3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:20.458725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 351/720] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:20.460220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cd43-8e67-409e-8fa3-d8acaf982170 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.460512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cd43-8e67-409e-8fa3-d8acaf982170 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.460789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cd43-8e67-409e-8fa3-d8acaf982170 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.462363 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 352/721] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:20.467480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 370/722] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:20.473834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc007d-d464-4b2c-b118-377ec54cc9dd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.474266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc007d-d464-4b2c-b118-377ec54cc9dd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.474649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc007d-d464-4b2c-b118-377ec54cc9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.503308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e9dc007d-d464-4b2c-b118-377ec54cc9dd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:20.504822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e9dc007d-d464-4b2c-b118-377ec54cc9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:20.598953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 353/723] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:20.757292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45523-f1e2-4862-8482-99d3e303db50 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.866814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:20.897343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45523-f1e2-4862-8482-99d3e303db50 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:20.934055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62115d-ab14-468d-b3d5-f587906c120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:20.934702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62115d-ab14-468d-b3d5-f587906c120e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:20.935018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62115d-ab14-468d-b3d5-f587906c120e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:20.935298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62115d-ab14-468d-b3d5-f587906c120e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:20.946599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62115d-ab14-468d-b3d5-f587906c120e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-7a62115d-ab14-468d-b3d5-f587906c120e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:20.951637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:20.952572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:20.954585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 371/724] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:20.959007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc007d-d464-4b2c-b118-377ec54cc9dd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:20.981229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62115d-ab14-468d-b3d5-f587906c120e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.003275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:21.160633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc007d-d464-4b2c-b118-377ec54cc9dd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.179890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62115d-ab14-468d-b3d5-f587906c120e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.231683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99845bd9-f24c-4e25-aac3-504b7e002bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.232305 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99845bd9-f24c-4e25-aac3-504b7e002bc7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.232586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99845bd9-f24c-4e25-aac3-504b7e002bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.232861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99845bd9-f24c-4e25-aac3-504b7e002bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.233533 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99845bd9-f24c-4e25-aac3-504b7e002bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:21.233837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99845bd9-f24c-4e25-aac3-504b7e002bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.236210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99845bd9-f24c-4e25-aac3-504b7e002bc7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:21.248961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48398c33-894c-4516-813d-7109778b8dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.249626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48398c33-894c-4516-813d-7109778b8dcd None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.250561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48398c33-894c-4516-813d-7109778b8dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.251001 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48398c33-894c-4516-813d-7109778b8dcd None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.251672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48398c33-894c-4516-813d-7109778b8dcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.253041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48398c33-894c-4516-813d-7109778b8dcd None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:21.260506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 354/725] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:21.263602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:21.266728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99845bd9-f24c-4e25-aac3-504b7e002bc7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.286614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 372/726] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:33:20 2022] POST /identity/v3/services => generated 251 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:33:21.376353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:21.405567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99845bd9-f24c-4e25-aac3-504b7e002bc7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.477266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bcd02-2ce9-4447-a567-e1253dee87fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.477967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bcd02-2ce9-4447-a567-e1253dee87fa None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.478311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bcd02-2ce9-4447-a567-e1253dee87fa None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.478651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bcd02-2ce9-4447-a567-e1253dee87fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.494904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bcd02-2ce9-4447-a567-e1253dee87fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.496602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bcd02-2ce9-4447-a567-e1253dee87fa None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-a16bcd02-2ce9-4447-a567-e1253dee87fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:21.517771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:21.518841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:21.519753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:21.519753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:21.519753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:21.519753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 355/727] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:21.528486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48398c33-894c-4516-813d-7109778b8dcd None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.664477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48398c33-894c-4516-813d-7109778b8dcd None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.706156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e96f6-479e-443f-aa73-97b0bc558081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.706793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e96f6-479e-443f-aa73-97b0bc558081 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.707075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e96f6-479e-443f-aa73-97b0bc558081 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.707353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e96f6-479e-443f-aa73-97b0bc558081 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.708005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e96f6-479e-443f-aa73-97b0bc558081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:21.708307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e96f6-479e-443f-aa73-97b0bc558081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.709703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e96f6-479e-443f-aa73-97b0bc558081 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:21.724022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 373/728] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:21.729423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bcd02-2ce9-4447-a567-e1253dee87fa None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:21.905058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bcd02-2ce9-4447-a567-e1253dee87fa None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:21.964672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:21.979575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f025a-13ff-46e3-9e21-f2e8cf0ebb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:21.980152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f025a-13ff-46e3-9e21-f2e8cf0ebb32 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:21.980436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f025a-13ff-46e3-9e21-f2e8cf0ebb32 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:21.980711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f025a-13ff-46e3-9e21-f2e8cf0ebb32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:21.995900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f025a-13ff-46e3-9e21-f2e8cf0ebb32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:21.997516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f025a-13ff-46e3-9e21-f2e8cf0ebb32 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-594f025a-13ff-46e3-9e21-f2e8cf0ebb32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:22.014758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:22.016047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:22.016998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 356/729] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:22.023840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e96f6-479e-443f-aa73-97b0bc558081 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:22.104057 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:22.166571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e96f6-479e-443f-aa73-97b0bc558081 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:22.215850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f77b6-5ae8-41eb-b1e4-a45eed24f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:22.216474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f77b6-5ae8-41eb-b1e4-a45eed24f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:22.216754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f77b6-5ae8-41eb-b1e4-a45eed24f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:22.217028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f77b6-5ae8-41eb-b1e4-a45eed24f7b5 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:22.217763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f77b6-5ae8-41eb-b1e4-a45eed24f7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:22.218070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f77b6-5ae8-41eb-b1e4-a45eed24f7b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:22.220254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f77b6-5ae8-41eb-b1e4-a45eed24f7b5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:22.246594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 374/730] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 11:33:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:22.252000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f025a-13ff-46e3-9e21-f2e8cf0ebb32 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:22.374338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f025a-13ff-46e3-9e21-f2e8cf0ebb32 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:22.413512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff31a6-b2be-4cb6-b059-85839525452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:22.414160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff31a6-b2be-4cb6-b059-85839525452e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:22.414503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff31a6-b2be-4cb6-b059-85839525452e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:22.414801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff31a6-b2be-4cb6-b059-85839525452e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:22.497659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:22.514524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff31a6-b2be-4cb6-b059-85839525452e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:22.516982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff31a6-b2be-4cb6-b059-85839525452e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:22.662160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 357/731] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:22 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:22.667414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f77b6-5ae8-41eb-b1e4-a45eed24f7b5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:22.802846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f77b6-5ae8-41eb-b1e4-a45eed24f7b5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:22.821779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:22.823211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94408d61-912e-4b3b-ba74-5a39a16d0190 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:22.823578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94408d61-912e-4b3b-ba74-5a39a16d0190 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:22.823942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94408d61-912e-4b3b-ba74-5a39a16d0190 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:22.826364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 358/732] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:22.834166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca0834-5c02-4147-8c7c-7eed33c422e6 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:22.834644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca0834-5c02-4147-8c7c-7eed33c422e6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:22.835005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca0834-5c02-4147-8c7c-7eed33c422e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:22.856963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23350e2a-8093-4841-b46a-1f54c620ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:22.857902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23350e2a-8093-4841-b46a-1f54c620ca21 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:22.858331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23350e2a-8093-4841-b46a-1f54c620ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:22.858751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23350e2a-8093-4841-b46a-1f54c620ca21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:22.858909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6cca0834-5c02-4147-8c7c-7eed33c422e6 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:22.861462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6cca0834-5c02-4147-8c7c-7eed33c422e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:22.882924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23350e2a-8093-4841-b46a-1f54c620ca21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:22.888332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23350e2a-8093-4841-b46a-1f54c620ca21 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-23350e2a-8093-4841-b46a-1f54c620ca21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:22.913943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:22.915160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:22.916254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:22.916254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:22.916254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:22.922795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 375/733] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:22.926638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23350e2a-8093-4841-b46a-1f54c620ca21 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:22.982425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 359/734] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:23.021925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e56286-ebd1-4017-a86a-8d72f1e4039d None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.022266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e56286-ebd1-4017-a86a-8d72f1e4039d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.022549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e56286-ebd1-4017-a86a-8d72f1e4039d None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.023926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 360/735] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:23.028996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb47e47-682f-4731-8031-5f92ac94a8de None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.029362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb47e47-682f-4731-8031-5f92ac94a8de None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.029640 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb47e47-682f-4731-8031-5f92ac94a8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.060256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-bdb47e47-682f-4731-8031-5f92ac94a8de None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:23.063310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bdb47e47-682f-4731-8031-5f92ac94a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:23.079002 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:23.095306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23350e2a-8093-4841-b46a-1f54c620ca21 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.132572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17e1de-005c-404e-a9f3-0b8c072e7c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.133238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17e1de-005c-404e-a9f3-0b8c072e7c3d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.133693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17e1de-005c-404e-a9f3-0b8c072e7c3d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.134162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17e1de-005c-404e-a9f3-0b8c072e7c3d None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.135470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17e1de-005c-404e-a9f3-0b8c072e7c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:23.135921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17e1de-005c-404e-a9f3-0b8c072e7c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:23.137269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 361/736] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 11:33:23.137456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17e1de-005c-404e-a9f3-0b8c072e7c3d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:23.138845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e57ac-e529-4298-98ce-0673c14d4883 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.139302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e57ac-e529-4298-98ce-0673c14d4883 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.139715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e57ac-e529-4298-98ce-0673c14d4883 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.145449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 362/737] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:23.147061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841f41-c816-4983-a7ef-1b36ebe62674 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.147522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841f41-c816-4983-a7ef-1b36ebe62674 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.147951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841f41-c816-4983-a7ef-1b36ebe62674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.152001 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 376/738] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:23.157635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17e1de-005c-404e-a9f3-0b8c072e7c3d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.166866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ea841f41-c816-4983-a7ef-1b36ebe62674 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:23.168256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ea841f41-c816-4983-a7ef-1b36ebe62674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:23.188278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:23.272577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17e1de-005c-404e-a9f3-0b8c072e7c3d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.312475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826558-c37c-4285-b443-e978ec2886c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.313520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826558-c37c-4285-b443-e978ec2886c7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.313950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826558-c37c-4285-b443-e978ec2886c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.314375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826558-c37c-4285-b443-e978ec2886c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.322313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66826558-c37c-4285-b443-e978ec2886c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:23.324388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66826558-c37c-4285-b443-e978ec2886c7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-66826558-c37c-4285-b443-e978ec2886c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:23.340895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:23.342016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:23.343166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:23.343166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:23.343166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:23.343166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:23.343166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:23.343166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:23.343166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:23.343166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:23.344263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 363/739] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:23.346521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 377/740] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:23.350942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841f41-c816-4983-a7ef-1b36ebe62674 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.352438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826558-c37c-4285-b443-e978ec2886c7 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.452033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:23.468324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826558-c37c-4285-b443-e978ec2886c7 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.506829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05881b6-9061-4af9-a3b3-2ac9d453fed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.510808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05881b6-9061-4af9-a3b3-2ac9d453fed9 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.510808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05881b6-9061-4af9-a3b3-2ac9d453fed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.510808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05881b6-9061-4af9-a3b3-2ac9d453fed9 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.510808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05881b6-9061-4af9-a3b3-2ac9d453fed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:23.510808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05881b6-9061-4af9-a3b3-2ac9d453fed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:23.510808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05881b6-9061-4af9-a3b3-2ac9d453fed9 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:23.516676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:23.524358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 378/741] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:23.525224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05881b6-9061-4af9-a3b3-2ac9d453fed9 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.539363 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841f41-c816-4983-a7ef-1b36ebe62674 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.575022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08049acd-0259-4472-b436-e154a61b7b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.575677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08049acd-0259-4472-b436-e154a61b7b6a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.576023 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08049acd-0259-4472-b436-e154a61b7b6a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.576365 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08049acd-0259-4472-b436-e154a61b7b6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.587455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08049acd-0259-4472-b436-e154a61b7b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-08049acd-0259-4472-b436-e154a61b7b6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:23.592206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:23.593152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:23.594521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 364/742] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:23.599754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08049acd-0259-4472-b436-e154a61b7b6a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.648405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05881b6-9061-4af9-a3b3-2ac9d453fed9 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.684602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0069f88-9600-4cd8-9f3d-506316630892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.685328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069f88-9600-4cd8-9f3d-506316630892 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.685616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069f88-9600-4cd8-9f3d-506316630892 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.685880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069f88-9600-4cd8-9f3d-506316630892 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.696933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0069f88-9600-4cd8-9f3d-506316630892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-e0069f88-9600-4cd8-9f3d-506316630892 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:23.702224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:23.703322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:23.704151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 379/743] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:23.704844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0069f88-9600-4cd8-9f3d-506316630892 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.713682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:23.715007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08049acd-0259-4472-b436-e154a61b7b6a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.751213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c763db-31a0-4547-af3c-b01cd9e2f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.751910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c763db-31a0-4547-af3c-b01cd9e2f772 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.752641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c763db-31a0-4547-af3c-b01cd9e2f772 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.752641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c763db-31a0-4547-af3c-b01cd9e2f772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.753368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c763db-31a0-4547-af3c-b01cd9e2f772 None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=d81a9aefdc6c4ada9baca8097927c03a) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:23.753737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c763db-31a0-4547-af3c-b01cd9e2f772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:23.755259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c763db-31a0-4547-af3c-b01cd9e2f772 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:23.761012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 365/744] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:23 2022] GET /identity/v3/role_assignments?user.id=d81a9aefdc6c4ada9baca8097927c03a&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:23.761766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c763db-31a0-4547-af3c-b01cd9e2f772 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.765102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:23.825520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0069f88-9600-4cd8-9f3d-506316630892 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.867921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f58e4b-a2d9-4ed0-a778-57db71b31786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.868552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f58e4b-a2d9-4ed0-a778-57db71b31786 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.868829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f58e4b-a2d9-4ed0-a778-57db71b31786 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.869101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f58e4b-a2d9-4ed0-a778-57db71b31786 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.870020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f58e4b-a2d9-4ed0-a778-57db71b31786 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:23.870542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f58e4b-a2d9-4ed0-a778-57db71b31786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:23.873191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f58e4b-a2d9-4ed0-a778-57db71b31786 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:23.895309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 380/745] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:23.896743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f58e4b-a2d9-4ed0-a778-57db71b31786 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.898947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c763db-31a0-4547-af3c-b01cd9e2f772 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:23.939882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cab86-62c9-4e91-8bb7-3f5ea875630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:23.940502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cab86-62c9-4e91-8bb7-3f5ea875630a None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.940785 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cab86-62c9-4e91-8bb7-3f5ea875630a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.941062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cab86-62c9-4e91-8bb7-3f5ea875630a None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.941750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cab86-62c9-4e91-8bb7-3f5ea875630a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:23.943107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4cab86-62c9-4e91-8bb7-3f5ea875630a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:23.965593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 366/746] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:33:23 2022] POST /identity/v3/services => generated 240 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:23.967137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea789-2688-45f1-8cf7-710e81946254 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:23.967608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea789-2688-45f1-8cf7-710e81946254 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:23.967887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea789-2688-45f1-8cf7-710e81946254 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:23.970073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 367/747] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:23.970715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ea789-2688-45f1-8cf7-710e81946254 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:23.999049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:24.046019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:24.051130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f58e4b-a2d9-4ed0-a778-57db71b31786 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:24.099644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ea789-2688-45f1-8cf7-710e81946254 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:24.103132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cbd78-e70d-4811-be20-06d33b5f6946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:24.104416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cbd78-e70d-4811-be20-06d33b5f6946 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.104849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cbd78-e70d-4811-be20-06d33b5f6946 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.105273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cbd78-e70d-4811-be20-06d33b5f6946 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.106105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cbd78-e70d-4811-be20-06d33b5f6946 None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:24.106587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cbd78-e70d-4811-be20-06d33b5f6946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:24.108294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cbd78-e70d-4811-be20-06d33b5f6946 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:24.124427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 381/748] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:24.126846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9e9d3-3b2e-4702-b530-59b40dd42d34 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.127395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9e9d3-3b2e-4702-b530-59b40dd42d34 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.127846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9e9d3-3b2e-4702-b530-59b40dd42d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.139827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8a525-e46e-47e1-8beb-8aa763a6cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:24.140526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8a525-e46e-47e1-8beb-8aa763a6cc14 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.140938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8a525-e46e-47e1-8beb-8aa763a6cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.141467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8a525-e46e-47e1-8beb-8aa763a6cc14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.149430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b0f9e9d3-3b2e-4702-b530-59b40dd42d34 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:24.151568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b0f9e9d3-3b2e-4702-b530-59b40dd42d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:24.153423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8a525-e46e-47e1-8beb-8aa763a6cc14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:24.155376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8a525-e46e-47e1-8beb-8aa763a6cc14 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-94e8a525-e46e-47e1-8beb-8aa763a6cc14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:24.170123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:24.171291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:24.173599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:24.173599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:24.173599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:24.173599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 368/749] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:24.173599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8a525-e46e-47e1-8beb-8aa763a6cc14 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:24.252488 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 382/750] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:24.253364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9e9d3-3b2e-4702-b530-59b40dd42d34 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:24.304379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8a525-e46e-47e1-8beb-8aa763a6cc14 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:24.318718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:24.337278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:24.354654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bced44-c4a1-4013-adfe-c708fbe9237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:24.355487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bced44-c4a1-4013-adfe-c708fbe9237c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.355772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bced44-c4a1-4013-adfe-c708fbe9237c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.356044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bced44-c4a1-4013-adfe-c708fbe9237c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.380360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bced44-c4a1-4013-adfe-c708fbe9237c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:24.382530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bced44-c4a1-4013-adfe-c708fbe9237c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-57bced44-c4a1-4013-adfe-c708fbe9237c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:24.415718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:24.416743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:24.417631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:24.417631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:24.417631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:24.417631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 369/751] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:24.424832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bced44-c4a1-4013-adfe-c708fbe9237c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:24.427853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9e9d3-3b2e-4702-b530-59b40dd42d34 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:24.522758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72de1-a21e-4408-b1f6-ff3ee7478ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:24.523795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72de1-a21e-4408-b1f6-ff3ee7478ac6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.524285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72de1-a21e-4408-b1f6-ff3ee7478ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.524763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf72de1-a21e-4408-b1f6-ff3ee7478ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.525642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72de1-a21e-4408-b1f6-ff3ee7478ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:24.526151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72de1-a21e-4408-b1f6-ff3ee7478ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:24.527765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf72de1-a21e-4408-b1f6-ff3ee7478ac6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:24.541840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bced44-c4a1-4013-adfe-c708fbe9237c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:24.565501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 383/752] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:24.572206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72de1-a21e-4408-b1f6-ff3ee7478ac6 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:24.586356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590a42c-3849-411b-b344-e4f68ad75856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:24.586999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590a42c-3849-411b-b344-e4f68ad75856 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.587281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590a42c-3849-411b-b344-e4f68ad75856 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.587554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590a42c-3849-411b-b344-e4f68ad75856 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.588205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590a42c-3849-411b-b344-e4f68ad75856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:24.588513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590a42c-3849-411b-b344-e4f68ad75856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:24.589879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590a42c-3849-411b-b344-e4f68ad75856 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:24.604783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 370/753] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:24.611711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590a42c-3849-411b-b344-e4f68ad75856 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:24.646664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:24.709374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf72de1-a21e-4408-b1f6-ff3ee7478ac6 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:24.727114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:24.752360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590a42c-3849-411b-b344-e4f68ad75856 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:24.761626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398873ff-db6e-4173-a3b2-65b6b754936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:24.762561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398873ff-db6e-4173-a3b2-65b6b754936b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.763591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398873ff-db6e-4173-a3b2-65b6b754936b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.764083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398873ff-db6e-4173-a3b2-65b6b754936b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.774334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398873ff-db6e-4173-a3b2-65b6b754936b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:24.775808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398873ff-db6e-4173-a3b2-65b6b754936b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-398873ff-db6e-4173-a3b2-65b6b754936b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:24.792208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:24.793210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:24.794178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:24.797018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c620e-7ce3-4d5a-9398-1224a85b74ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:24.798026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c620e-7ce3-4d5a-9398-1224a85b74ef None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.798260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c620e-7ce3-4d5a-9398-1224a85b74ef None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.798664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c620e-7ce3-4d5a-9398-1224a85b74ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.798947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 384/754] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 11:33:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:24.800162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398873ff-db6e-4173-a3b2-65b6b754936b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:24.809057 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c620e-7ce3-4d5a-9398-1224a85b74ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:24.810733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c620e-7ce3-4d5a-9398-1224a85b74ef None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-914c620e-7ce3-4d5a-9398-1224a85b74ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:24.824052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:24.825060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:24.825994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 371/755] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:33:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:24.826574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c620e-7ce3-4d5a-9398-1224a85b74ef None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:24.918312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:24.920509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398873ff-db6e-4173-a3b2-65b6b754936b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:24.940571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c620e-7ce3-4d5a-9398-1224a85b74ef None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:24.972836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602be3-2538-4bf7-a16f-821b4245e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:24.973719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602be3-2538-4bf7-a16f-821b4245e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.974142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602be3-2538-4bf7-a16f-821b4245e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.974556 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602be3-2538-4bf7-a16f-821b4245e9d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.975330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602be3-2538-4bf7-a16f-821b4245e9d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:24.976854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602be3-2538-4bf7-a16f-821b4245e9d5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:24.977254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c25d5-d202-4c58-b173-21f25d697f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:24.977954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c25d5-d202-4c58-b173-21f25d697f5c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:24.978333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c25d5-d202-4c58-b173-21f25d697f5c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:24.978696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c25d5-d202-4c58-b173-21f25d697f5c None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:24.979595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c25d5-d202-4c58-b173-21f25d697f5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:24.979995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c25d5-d202-4c58-b173-21f25d697f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:24.981749 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c25d5-d202-4c58-b173-21f25d697f5c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-ea602be3-2538-4bf7-a16f-821b4245e9d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:24.990741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:24.991979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:33:24.992931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:24.995438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 385/756] 10.222.0.59 () {56 vars in 1129 bytes} [Wed Aug 24 11:33:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:24.996406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602be3-2538-4bf7-a16f-821b4245e9d5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.011968 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 372/757] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 11:33:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:25.011968 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c25d5-d202-4c58-b173-21f25d697f5c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.048132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:25.112493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602be3-2538-4bf7-a16f-821b4245e9d5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.117983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c25d5-d202-4c58-b173-21f25d697f5c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.151236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833c248-778c-41eb-b09d-d39341a59231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.152243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c248-778c-41eb-b09d-d39341a59231 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.152703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c248-778c-41eb-b09d-d39341a59231 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.153146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c248-778c-41eb-b09d-d39341a59231 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.154047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833c248-778c-41eb-b09d-d39341a59231 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:25.154522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833c248-778c-41eb-b09d-d39341a59231 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.156684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833c248-778c-41eb-b09d-d39341a59231 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.156798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e998-0b64-4f50-9ffd-35fd25c92185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.157687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e998-0b64-4f50-9ffd-35fd25c92185 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.158056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e998-0b64-4f50-9ffd-35fd25c92185 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.158400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e998-0b64-4f50-9ffd-35fd25c92185 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.159304 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e998-0b64-4f50-9ffd-35fd25c92185 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:25.159747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e998-0b64-4f50-9ffd-35fd25c92185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.161570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e998-0b64-4f50-9ffd-35fd25c92185 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.170790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 373/758] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:25.171676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e998-0b64-4f50-9ffd-35fd25c92185 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.183142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 386/759] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 11:33:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:25.183812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:25.185358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833c248-778c-41eb-b09d-d39341a59231 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.289874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e998-0b64-4f50-9ffd-35fd25c92185 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.295154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:25.299722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833c248-778c-41eb-b09d-d39341a59231 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.332027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470da9e-15d5-47b1-9655-ef090aa96cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.332661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470da9e-15d5-47b1-9655-ef090aa96cfa None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.332938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470da9e-15d5-47b1-9655-ef090aa96cfa None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.333364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470da9e-15d5-47b1-9655-ef090aa96cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.339311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d619117-30c9-47b8-b69e-0dbd8207f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.340296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d619117-30c9-47b8-b69e-0dbd8207f274 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.340772 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d619117-30c9-47b8-b69e-0dbd8207f274 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.341252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d619117-30c9-47b8-b69e-0dbd8207f274 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.342294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d619117-30c9-47b8-b69e-0dbd8207f274 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:25.342823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d619117-30c9-47b8-b69e-0dbd8207f274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.344334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470da9e-15d5-47b1-9655-ef090aa96cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.344718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d619117-30c9-47b8-b69e-0dbd8207f274 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.345795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470da9e-15d5-47b1-9655-ef090aa96cfa None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.351059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 387/760] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:25.352210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d619117-30c9-47b8-b69e-0dbd8207f274 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-7470da9e-15d5-47b1-9655-ef090aa96cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:25.367410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:25.368707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:25.369586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:25.369586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:25.369586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:25.373232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 374/761] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:25.374223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470da9e-15d5-47b1-9655-ef090aa96cfa None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.439830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:25.469580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d619117-30c9-47b8-b69e-0dbd8207f274 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.490595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470da9e-15d5-47b1-9655-ef090aa96cfa None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.508910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9d2f0-a4f7-4cfd-9a23-ff51a57ac836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.509962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9d2f0-a4f7-4cfd-9a23-ff51a57ac836 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.510718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9d2f0-a4f7-4cfd-9a23-ff51a57ac836 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.511259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9d2f0-a4f7-4cfd-9a23-ff51a57ac836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.529494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491176dd-c457-4190-b916-076bfd69cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.530065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491176dd-c457-4190-b916-076bfd69cae5 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.530353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491176dd-c457-4190-b916-076bfd69cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.530630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491176dd-c457-4190-b916-076bfd69cae5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.531542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491176dd-c457-4190-b916-076bfd69cae5 None admin] RBAC: Adding query filter params (interface=public, service_id=61905f6ea5ea401aba715d03220e0f48, region_id=RegionOne) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:25.532215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491176dd-c457-4190-b916-076bfd69cae5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.533732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491176dd-c457-4190-b916-076bfd69cae5 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.544820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 375/762] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/endpoints?service_id=61905f6ea5ea401aba715d03220e0f48&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:25.545690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491176dd-c457-4190-b916-076bfd69cae5 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.549575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:25.591288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9d2f0-a4f7-4cfd-9a23-ff51a57ac836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.593053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9d2f0-a4f7-4cfd-9a23-ff51a57ac836 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.666836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491176dd-c457-4190-b916-076bfd69cae5 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.692714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:25.707244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f3d5e-bbf1-442b-b10a-91808c83b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.708136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f3d5e-bbf1-442b-b10a-91808c83b519 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.708643 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f3d5e-bbf1-442b-b10a-91808c83b519 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.709068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f3d5e-bbf1-442b-b10a-91808c83b519 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.709883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f3d5e-bbf1-442b-b10a-91808c83b519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:25.710402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f3d5e-bbf1-442b-b10a-91808c83b519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.712044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f3d5e-bbf1-442b-b10a-91808c83b519 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.714322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 388/763] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:33:25.715370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9d2f0-a4f7-4cfd-9a23-ff51a57ac836 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.726864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 376/764] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:25.728094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f3d5e-bbf1-442b-b10a-91808c83b519 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.782790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:25.825590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9d2f0-a4f7-4cfd-9a23-ff51a57ac836 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.845512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f3d5e-bbf1-442b-b10a-91808c83b519 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:25.868182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8461906-0e65-4c13-a4f0-f85799dc9bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.868914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461906-0e65-4c13-a4f0-f85799dc9bc2 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.869198 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461906-0e65-4c13-a4f0-f85799dc9bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.869503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461906-0e65-4c13-a4f0-f85799dc9bc2 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.870189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8461906-0e65-4c13-a4f0-f85799dc9bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.871708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8461906-0e65-4c13-a4f0-f85799dc9bc2 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.881957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87529b2-d2bc-4191-a7d4-e99df0a5b9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:25.882677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87529b2-d2bc-4191-a7d4-e99df0a5b9db None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.882993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87529b2-d2bc-4191-a7d4-e99df0a5b9db None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.883334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87529b2-d2bc-4191-a7d4-e99df0a5b9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.889710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 389/765] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:25.892693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8461906-0e65-4c13-a4f0-f85799dc9bc2 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.896377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87529b2-d2bc-4191-a7d4-e99df0a5b9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:25.897872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87529b2-d2bc-4191-a7d4-e99df0a5b9db None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-f87529b2-d2bc-4191-a7d4-e99df0a5b9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:25.917284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:25.918323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:25.919264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:25.919264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:25.919264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:25.925062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 377/766] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:25.933088 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbebb9-83a1-40ef-8e7b-66b2bf8b6e8a None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:25.933310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbebb9-83a1-40ef-8e7b-66b2bf8b6e8a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:25.933561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbebb9-83a1-40ef-8e7b-66b2bf8b6e8a None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:25.935512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 378/767] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:25.936331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbebb9-83a1-40ef-8e7b-66b2bf8b6e8a None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:25.985849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:26.053164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8461906-0e65-4c13-a4f0-f85799dc9bc2 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:26.074522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbebb9-83a1-40ef-8e7b-66b2bf8b6e8a None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:26.088606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:26.104226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c385063-ff59-4e91-ba53-9437584928b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:26.105142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c385063-ff59-4e91-ba53-9437584928b6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.105304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c385063-ff59-4e91-ba53-9437584928b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.105678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c385063-ff59-4e91-ba53-9437584928b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.113871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c385063-ff59-4e91-ba53-9437584928b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:26.115499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c385063-ff59-4e91-ba53-9437584928b6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:26.123983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a655fc5-9299-485e-8011-66af78ddc3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:26.125474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655fc5-9299-485e-8011-66af78ddc3ff None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.126124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655fc5-9299-485e-8011-66af78ddc3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.126630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655fc5-9299-485e-8011-66af78ddc3ff None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.127547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a655fc5-9299-485e-8011-66af78ddc3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:26.128044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a655fc5-9299-485e-8011-66af78ddc3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-3c385063-ff59-4e91-ba53-9437584928b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:26.129212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:26.130383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:26.131470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:26.131470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:26.131470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:26.131470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:26.131470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:26.131470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:26.131470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:26.131470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:26.131470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 390/768] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:26.132682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a655fc5-9299-485e-8011-66af78ddc3ff None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:26.133139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a8e3c-f970-498c-b3b6-fc1851a7dd24 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.133515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a8e3c-f970-498c-b3b6-fc1851a7dd24 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.133885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a8e3c-f970-498c-b3b6-fc1851a7dd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.147708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 379/769] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:26.149318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaddef5-9f51-4402-abdf-d8f28e483fd0 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.149747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaddef5-9f51-4402-abdf-d8f28e483fd0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.150205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaddef5-9f51-4402-abdf-d8f28e483fd0 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.151881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 380/770] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:26.152732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaddef5-9f51-4402-abdf-d8f28e483fd0 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:26.157742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-159a8e3c-f970-498c-b3b6-fc1851a7dd24 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:26.159402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-159a8e3c-f970-498c-b3b6-fc1851a7dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:26.247002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 391/771] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:26.248177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a8e3c-f970-498c-b3b6-fc1851a7dd24 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:26.270701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:26.279384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaddef5-9f51-4402-abdf-d8f28e483fd0 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:26.325727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b69af1-8f6a-42ef-9f5e-425b0990d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:26.326408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b69af1-8f6a-42ef-9f5e-425b0990d491 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.326693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b69af1-8f6a-42ef-9f5e-425b0990d491 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.326994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b69af1-8f6a-42ef-9f5e-425b0990d491 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.327716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b69af1-8f6a-42ef-9f5e-425b0990d491 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:26.328028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b69af1-8f6a-42ef-9f5e-425b0990d491 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:26.330210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b69af1-8f6a-42ef-9f5e-425b0990d491 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:26.347010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 381/772] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:26.347010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b51a63-f683-4f75-845d-0f0c7b3f1706 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.347010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b51a63-f683-4f75-845d-0f0c7b3f1706 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.347010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b51a63-f683-4f75-845d-0f0c7b3f1706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.366067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e7b51a63-f683-4f75-845d-0f0c7b3f1706 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:26.367322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e7b51a63-f683-4f75-845d-0f0c7b3f1706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:26.380533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a8e3c-f970-498c-b3b6-fc1851a7dd24 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:26.399777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:26.425246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec815e-0e1c-402d-bcd8-cf332ced805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:26.426277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec815e-0e1c-402d-bcd8-cf332ced805a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.426798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec815e-0e1c-402d-bcd8-cf332ced805a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.427276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec815e-0e1c-402d-bcd8-cf332ced805a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.438489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec815e-0e1c-402d-bcd8-cf332ced805a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:26.440672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec815e-0e1c-402d-bcd8-cf332ced805a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:26.447531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 382/773] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:26.447531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b51a63-f683-4f75-845d-0f0c7b3f1706 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-68ec815e-0e1c-402d-bcd8-cf332ced805a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:26.466930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:26.467853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:26.469315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:26.469315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:26.469315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:26.469315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:26.469315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:26.469315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:26.469315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:26.469315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:26.471273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 392/774] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:26.477588 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec815e-0e1c-402d-bcd8-cf332ced805a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:26.627136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:26.630546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b51a63-f683-4f75-845d-0f0c7b3f1706 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:26.637648 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec815e-0e1c-402d-bcd8-cf332ced805a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:26.683538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8498-fa8a-43fd-ae23-008c3bbb77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:26.684186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8498-fa8a-43fd-ae23-008c3bbb77ff None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.684470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8498-fa8a-43fd-ae23-008c3bbb77ff None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.684758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8498-fa8a-43fd-ae23-008c3bbb77ff None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/46e2fac1066d4ad7b670d46f158fec97/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.686653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea8498-fa8a-43fd-ae23-008c3bbb77ff None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=46e2fac1066d4ad7b670d46f158fec97, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:26.688592 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adc0d2-3dcd-4242-bd2d-e6f65c349cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:26.688757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea8498-fa8a-43fd-ae23-008c3bbb77ff None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:26.689493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adc0d2-3dcd-4242-bd2d-e6f65c349cc9 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.689936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adc0d2-3dcd-4242-bd2d-e6f65c349cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.690351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adc0d2-3dcd-4242-bd2d-e6f65c349cc9 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.691381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adc0d2-3dcd-4242-bd2d-e6f65c349cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:26.691971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adc0d2-3dcd-4242-bd2d-e6f65c349cc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:26.693811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adc0d2-3dcd-4242-bd2d-e6f65c349cc9 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:26.704269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 383/775] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:33:26 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/46e2fac1066d4ad7b670d46f158fec97/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:26.705560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8498-fa8a-43fd-ae23-008c3bbb77ff None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:26.708441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 393/776] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:26.713931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adc0d2-3dcd-4242-bd2d-e6f65c349cc9 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:26.789405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:26.834126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8498-fa8a-43fd-ae23-008c3bbb77ff None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:26.871755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adc0d2-3dcd-4242-bd2d-e6f65c349cc9 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:26.877600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424b308-d297-4aac-a575-2957719bfc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:26.878533 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424b308-d297-4aac-a575-2957719bfc4e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.879008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424b308-d297-4aac-a575-2957719bfc4e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.879427 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424b308-d297-4aac-a575-2957719bfc4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.895439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424b308-d297-4aac-a575-2957719bfc4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-e424b308-d297-4aac-a575-2957719bfc4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:26.900520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:26.901463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:26.902327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:26.903009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 384/777] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:26.903717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424b308-d297-4aac-a575-2957719bfc4e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:26.912616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:26.920961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ab632-3885-4864-b054-a3effc4a94a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:26.922174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ab632-3885-4864-b054-a3effc4a94a7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:26.922461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ab632-3885-4864-b054-a3effc4a94a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:26.922736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ab632-3885-4864-b054-a3effc4a94a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:26.923507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ab632-3885-4864-b054-a3effc4a94a7 None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=1e97f5a53a9248438740d138d69596dd) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:26.923817 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ab632-3885-4864-b054-a3effc4a94a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:26.925287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ab632-3885-4864-b054-a3effc4a94a7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:26.931852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 394/778] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:26 2022] GET /identity/v3/role_assignments?user.id=1e97f5a53a9248438740d138d69596dd&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:26.932820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ab632-3885-4864-b054-a3effc4a94a7 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.090028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:27.095882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ab632-3885-4864-b054-a3effc4a94a7 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.127074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424b308-d297-4aac-a575-2957719bfc4e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.159389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6df14-6c9c-4a97-8cca-11e8ac2bfea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.159913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6df14-6c9c-4a97-8cca-11e8ac2bfea3 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.160197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6df14-6c9c-4a97-8cca-11e8ac2bfea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.160470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6df14-6c9c-4a97-8cca-11e8ac2bfea3 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.161132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6df14-6c9c-4a97-8cca-11e8ac2bfea3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:27.166960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1622d8-f867-4106-b128-13a48e8134f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.167329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6df14-6c9c-4a97-8cca-11e8ac2bfea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.167675 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1622d8-f867-4106-b128-13a48e8134f7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.167959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1622d8-f867-4106-b128-13a48e8134f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.168232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1622d8-f867-4106-b128-13a48e8134f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.168791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6df14-6c9c-4a97-8cca-11e8ac2bfea3 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.168905 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1622d8-f867-4106-b128-13a48e8134f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.170164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1622d8-f867-4106-b128-13a48e8134f7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-ef1622d8-f867-4106-b128-13a48e8134f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:27.180361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:27.181442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:27.182257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 385/779] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:26 2022] GET /identity/v3/services/network => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:27.183834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 395/780] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:27.189600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1622d8-f867-4106-b128-13a48e8134f7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.189812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6df14-6c9c-4a97-8cca-11e8ac2bfea3 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.271121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:27.306867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1622d8-f867-4106-b128-13a48e8134f7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.330348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6df14-6c9c-4a97-8cca-11e8ac2bfea3 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.342847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e968ab-18cd-4714-b115-d6a661317164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.344189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e968ab-18cd-4714-b115-d6a661317164 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.344631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e968ab-18cd-4714-b115-d6a661317164 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.344935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e968ab-18cd-4714-b115-d6a661317164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.356203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e968ab-18cd-4714-b115-d6a661317164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.357821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e968ab-18cd-4714-b115-d6a661317164 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.366745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95086423-8be1-433f-9cdd-5cd5ccfdaded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.367392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95086423-8be1-433f-9cdd-5cd5ccfdaded None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.367677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95086423-8be1-433f-9cdd-5cd5ccfdaded None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.367951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95086423-8be1-433f-9cdd-5cd5ccfdaded None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.368586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95086423-8be1-433f-9cdd-5cd5ccfdaded None admin] RBAC: Adding query filter params (name=network) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:27.368892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95086423-8be1-433f-9cdd-5cd5ccfdaded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.370262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95086423-8be1-433f-9cdd-5cd5ccfdaded None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.376399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 396/781] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-d8e968ab-18cd-4714-b115-d6a661317164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:27.378899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:27.380426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:27.382077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:27.382077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:27.382077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:27.384460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 386/782] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:27.385900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95086423-8be1-433f-9cdd-5cd5ccfdaded None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.389704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e968ab-18cd-4714-b115-d6a661317164 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.451524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:27.532009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e968ab-18cd-4714-b115-d6a661317164 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.563743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:27.568396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95086423-8be1-433f-9cdd-5cd5ccfdaded None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.590175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf3828-4712-4345-8d48-04d18f4285ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.590882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf3828-4712-4345-8d48-04d18f4285ae None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.591173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf3828-4712-4345-8d48-04d18f4285ae None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.591450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf3828-4712-4345-8d48-04d18f4285ae None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.592119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf3828-4712-4345-8d48-04d18f4285ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:27.592429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf3828-4712-4345-8d48-04d18f4285ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.594104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf3828-4712-4345-8d48-04d18f4285ae None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.605295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53873c32-d094-40e9-bda8-a01595b7bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.606024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53873c32-d094-40e9-bda8-a01595b7bd76 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.606372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53873c32-d094-40e9-bda8-a01595b7bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.606708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53873c32-d094-40e9-bda8-a01595b7bd76 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.607499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53873c32-d094-40e9-bda8-a01595b7bd76 None admin] RBAC: Adding query filter params (type=network) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:27.608055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53873c32-d094-40e9-bda8-a01595b7bd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.610145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53873c32-d094-40e9-bda8-a01595b7bd76 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.616446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 397/783] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:27.626117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 387/784] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:27.627250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53873c32-d094-40e9-bda8-a01595b7bd76 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.631628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf3828-4712-4345-8d48-04d18f4285ae None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.750206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:27.761872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53873c32-d094-40e9-bda8-a01595b7bd76 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.839814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0af0af-6b4f-401c-9e55-1de7a965c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.841971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0af0af-6b4f-401c-9e55-1de7a965c358 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.843488 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0af0af-6b4f-401c-9e55-1de7a965c358 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.843952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0af0af-6b4f-401c-9e55-1de7a965c358 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.845499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0af0af-6b4f-401c-9e55-1de7a965c358 None admin] RBAC: Adding query filter params (interface=public, service_id=bf3746391561407c94c03080e7cb271a, region_id=RegionOne) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:27.847911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf3828-4712-4345-8d48-04d18f4285ae None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:27.848458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0af0af-6b4f-401c-9e55-1de7a965c358 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:27.850032 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0af0af-6b4f-401c-9e55-1de7a965c358 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:27.869301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 398/785] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 11:33:27 2022] GET /identity/v3/endpoints?service_id=bf3746391561407c94c03080e7cb271a&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:27.875515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0af0af-6b4f-401c-9e55-1de7a965c358 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:27.975581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e47b-232f-4a0b-b5cb-0c9a61613bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:27.976250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e47b-232f-4a0b-b5cb-0c9a61613bd2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:27.976615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e47b-232f-4a0b-b5cb-0c9a61613bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:27.976961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e47b-232f-4a0b-b5cb-0c9a61613bd2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:27.997497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0af0af-6b4f-401c-9e55-1de7a965c358 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.009008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e47b-232f-4a0b-b5cb-0c9a61613bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.010743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e47b-232f-4a0b-b5cb-0c9a61613bd2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:28.036347 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9d6b8-a5c0-4fc7-aed6-5b755351ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:28.037263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9d6b8-a5c0-4fc7-aed6-5b755351ce5f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.037755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9d6b8-a5c0-4fc7-aed6-5b755351ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.038207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9d6b8-a5c0-4fc7-aed6-5b755351ce5f None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.039020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9d6b8-a5c0-4fc7-aed6-5b755351ce5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-df91e47b-232f-4a0b-b5cb-0c9a61613bd2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:28.040254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:28.041167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:28.042110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 388/786] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:28.043569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9d6b8-a5c0-4fc7-aed6-5b755351ce5f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:28.050146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 399/787] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 11:33:27 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:28.051765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e47b-232f-4a0b-b5cb-0c9a61613bd2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:28.102359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:28.144380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008bbc-1c3f-476c-87bd-db4b0531f6f4 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.144742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008bbc-1c3f-476c-87bd-db4b0531f6f4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.144930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008bbc-1c3f-476c-87bd-db4b0531f6f4 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.147248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 400/788] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:28.155344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db68fdc-62b8-483e-bd9c-a1481228cf70 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.156299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db68fdc-62b8-483e-bd9c-a1481228cf70 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.156672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db68fdc-62b8-483e-bd9c-a1481228cf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.176139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e47b-232f-4a0b-b5cb-0c9a61613bd2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.186794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9db68fdc-62b8-483e-bd9c-a1481228cf70 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:28.186794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9db68fdc-62b8-483e-bd9c-a1481228cf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:28.207224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:28.275130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb2bbe-b9e8-4b5b-9003-6441c2f4fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:28.275649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb2bbe-b9e8-4b5b-9003-6441c2f4fb11 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.275931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb2bbe-b9e8-4b5b-9003-6441c2f4fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.276248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb2bbe-b9e8-4b5b-9003-6441c2f4fb11 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.276952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb2bbe-b9e8-4b5b-9003-6441c2f4fb11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:28.277260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb2bbe-b9e8-4b5b-9003-6441c2f4fb11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.278699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb2bbe-b9e8-4b5b-9003-6441c2f4fb11 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:28.304179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 389/789] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 11:33:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:28.310493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb2bbe-b9e8-4b5b-9003-6441c2f4fb11 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:28.430252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:28.435292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb2bbe-b9e8-4b5b-9003-6441c2f4fb11 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.445809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 401/790] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:28.478064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce990-7590-44ae-bf77-59b3a5c26da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:28.479015 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce990-7590-44ae-bf77-59b3a5c26da1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.479443 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce990-7590-44ae-bf77-59b3a5c26da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.479862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce990-7590-44ae-bf77-59b3a5c26da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.497669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ce990-7590-44ae-bf77-59b3a5c26da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.499399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ce990-7590-44ae-bf77-59b3a5c26da1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-379ce990-7590-44ae-bf77-59b3a5c26da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:28.522981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:28.524159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:28.525277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:28.525277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:28.525277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:28.527045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 390/791] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:28.533188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db68fdc-62b8-483e-bd9c-a1481228cf70 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:28.698686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db68fdc-62b8-483e-bd9c-a1481228cf70 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.750440 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce990-7590-44ae-bf77-59b3a5c26da1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:28.751594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ffc36-cbc6-43fa-b3dc-aed554b8b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:28.752231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ffc36-cbc6-43fa-b3dc-aed554b8b486 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.752520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ffc36-cbc6-43fa-b3dc-aed554b8b486 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.752794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ffc36-cbc6-43fa-b3dc-aed554b8b486 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.753451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ffc36-cbc6-43fa-b3dc-aed554b8b486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:28.753754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ffc36-cbc6-43fa-b3dc-aed554b8b486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.755447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ffc36-cbc6-43fa-b3dc-aed554b8b486 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:28.781957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 402/792] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:28.788256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ffc36-cbc6-43fa-b3dc-aed554b8b486 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:28.803931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:28.898317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce990-7590-44ae-bf77-59b3a5c26da1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.969807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ffc36-cbc6-43fa-b3dc-aed554b8b486 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:28.985108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cae57-adee-49af-a022-c7b7d3b92272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:28.985767 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cae57-adee-49af-a022-c7b7d3b92272 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:28.986050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cae57-adee-49af-a022-c7b7d3b92272 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:28.986326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cae57-adee-49af-a022-c7b7d3b92272 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:28.986956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cae57-adee-49af-a022-c7b7d3b92272 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:28.988333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cae57-adee-49af-a022-c7b7d3b92272 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.007839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377932-ae35-4122-8091-04154bbb5a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.008562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377932-ae35-4122-8091-04154bbb5a89 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-c53cae57-adee-49af-a022-c7b7d3b92272 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:29.008690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:29.009779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 11:33:29.010896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:29.011619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377932-ae35-4122-8091-04154bbb5a89 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.011704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 391/793] 10.222.0.59 () {56 vars in 1129 bytes} [Wed Aug 24 11:33:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:29.011773 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377932-ae35-4122-8091-04154bbb5a89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.019786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cae57-adee-49af-a022-c7b7d3b92272 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.027154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19377932-ae35-4122-8091-04154bbb5a89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.028608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19377932-ae35-4122-8091-04154bbb5a89 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-19377932-ae35-4122-8091-04154bbb5a89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:29.050660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:29.052733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:29.054815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:29.054815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:29.054815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:29.054815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:29.054815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:29.054815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:29.054815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:29.054815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:29.054815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 403/794] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:29.059149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:29.065072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377932-ae35-4122-8091-04154bbb5a89 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.149230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:29.186094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cae57-adee-49af-a022-c7b7d3b92272 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.191152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377932-ae35-4122-8091-04154bbb5a89 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.224660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0832252-e7fa-4f49-825c-77f738a9e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.225297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0832252-e7fa-4f49-825c-77f738a9e516 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.225534 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0832252-e7fa-4f49-825c-77f738a9e516 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.225870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0832252-e7fa-4f49-825c-77f738a9e516 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.226460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0832252-e7fa-4f49-825c-77f738a9e516 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:29.226792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0832252-e7fa-4f49-825c-77f738a9e516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.227363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc6adb-d349-4aa5-8912-3ee5a310ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.227968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6adb-d349-4aa5-8912-3ee5a310ed8d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.228146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0832252-e7fa-4f49-825c-77f738a9e516 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.228240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6adb-d349-4aa5-8912-3ee5a310ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.228505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6adb-d349-4aa5-8912-3ee5a310ed8d None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.229478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc6adb-d349-4aa5-8912-3ee5a310ed8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:29.230154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc6adb-d349-4aa5-8912-3ee5a310ed8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.231897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc6adb-d349-4aa5-8912-3ee5a310ed8d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.240476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 392/795] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 11:33:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:29.240476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fee51-430c-41ef-8ac0-3edb9f95880a None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.240476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fee51-430c-41ef-8ac0-3edb9f95880a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.240476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fee51-430c-41ef-8ac0-3edb9f95880a None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.240476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 393/796] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:29.240476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61c70-3830-42a6-98b2-f37112df08b1 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.240955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61c70-3830-42a6-98b2-f37112df08b1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.240955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61c70-3830-42a6-98b2-f37112df08b1 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.240955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 394/797] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:29.243768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041f66-2ac1-4421-af71-e6bf379050ef None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.243768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041f66-2ac1-4421-af71-e6bf379050ef None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.246364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041f66-2ac1-4421-af71-e6bf379050ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.253116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 404/798] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:29.254818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33ab80-6c8a-4c32-a9fe-55264c184fbb None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.254818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33ab80-6c8a-4c32-a9fe-55264c184fbb None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.255785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33ab80-6c8a-4c32-a9fe-55264c184fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.268370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-aa041f66-2ac1-4421-af71-e6bf379050ef None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:29.269992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-aa041f66-2ac1-4421-af71-e6bf379050ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:29.274578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9d33ab80-6c8a-4c32-a9fe-55264c184fbb None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:29.275790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9d33ab80-6c8a-4c32-a9fe-55264c184fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:29.342402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 395/799] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:29.343766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041f66-2ac1-4421-af71-e6bf379050ef None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.359669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:29.364897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 405/800] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:29.365894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33ab80-6c8a-4c32-a9fe-55264c184fbb None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.493569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:29.500823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041f66-2ac1-4421-af71-e6bf379050ef None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.555240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591f913-e458-4924-abfd-ffc0b024b14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.555858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591f913-e458-4924-abfd-ffc0b024b14e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.556137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591f913-e458-4924-abfd-ffc0b024b14e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.556407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591f913-e458-4924-abfd-ffc0b024b14e None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.557047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591f913-e458-4924-abfd-ffc0b024b14e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:29.557348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591f913-e458-4924-abfd-ffc0b024b14e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.558731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591f913-e458-4924-abfd-ffc0b024b14e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.569561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 396/801] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 11:33:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:29.576588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591f913-e458-4924-abfd-ffc0b024b14e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.582176 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33ab80-6c8a-4c32-a9fe-55264c184fbb None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.656796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a3817-f82a-4d11-9c39-ff2ef60ced71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.657489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a3817-f82a-4d11-9c39-ff2ef60ced71 None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.657767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a3817-f82a-4d11-9c39-ff2ef60ced71 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.658037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a3817-f82a-4d11-9c39-ff2ef60ced71 None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/d81a9aefdc6c4ada9baca8097927c03a/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.662192 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a3817-f82a-4d11-9c39-ff2ef60ced71 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=d81a9aefdc6c4ada9baca8097927c03a, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.663883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a3817-f82a-4d11-9c39-ff2ef60ced71 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.681870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 406/802] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:33:29 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/d81a9aefdc6c4ada9baca8097927c03a/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:29.682806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a3817-f82a-4d11-9c39-ff2ef60ced71 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.690737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:29.728337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591f913-e458-4924-abfd-ffc0b024b14e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.769840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dcdcc-6299-4ea9-bfff-e7cf5df77151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.771501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dcdcc-6299-4ea9-bfff-e7cf5df77151 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.772128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dcdcc-6299-4ea9-bfff-e7cf5df77151 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.772631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dcdcc-6299-4ea9-bfff-e7cf5df77151 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.773629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dcdcc-6299-4ea9-bfff-e7cf5df77151 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:29.775541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dcdcc-6299-4ea9-bfff-e7cf5df77151 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:29.815620 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 397/803] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:29.816088 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dcdcc-6299-4ea9-bfff-e7cf5df77151 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.841597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a3817-f82a-4d11-9c39-ff2ef60ced71 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:29.868828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:29.902425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3e7f1-b39b-4872-8d35-cae58e63a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:29.903524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3e7f1-b39b-4872-8d35-cae58e63a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:29.903966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3e7f1-b39b-4872-8d35-cae58e63a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:29.904255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3e7f1-b39b-4872-8d35-cae58e63a0a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:29.920945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3e7f1-b39b-4872-8d35-cae58e63a0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-57e3e7f1-b39b-4872-8d35-cae58e63a0a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:29.930016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:29.931216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:29.932056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 407/804] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:29.947176 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3e7f1-b39b-4872-8d35-cae58e63a0a8 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:29.977955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dcdcc-6299-4ea9-bfff-e7cf5df77151 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.010834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:30.021961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ad24a-6b0f-43d2-ac12-a7c67fe04b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.022990 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ad24a-6b0f-43d2-ac12-a7c67fe04b9e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.023537 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ad24a-6b0f-43d2-ac12-a7c67fe04b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.024026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ad24a-6b0f-43d2-ac12-a7c67fe04b9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.037514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ad24a-6b0f-43d2-ac12-a7c67fe04b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-c73ad24a-6b0f-43d2-ac12-a7c67fe04b9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:30.043575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:30.044484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:30.045310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:30.048450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 398/805] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:30.054599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ad24a-6b0f-43d2-ac12-a7c67fe04b9e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.125999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3e7f1-b39b-4872-8d35-cae58e63a0a8 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.166115 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d15a-6b5b-4841-bb89-c5ac837844ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.166880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d15a-6b5b-4841-bb89-c5ac837844ac None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.167108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d15a-6b5b-4841-bb89-c5ac837844ac None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.167382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d15a-6b5b-4841-bb89-c5ac837844ac None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.168049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d15a-6b5b-4841-bb89-c5ac837844ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:30.168477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d15a-6b5b-4841-bb89-c5ac837844ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.169786 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d15a-6b5b-4841-bb89-c5ac837844ac None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.180147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ad24a-6b0f-43d2-ac12-a7c67fe04b9e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.180473 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 408/806] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:30.188938 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d15a-6b5b-4841-bb89-c5ac837844ac None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.228175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1dd01-fc95-4791-bb6c-f7c93eecc3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.228786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1dd01-fc95-4791-bb6c-f7c93eecc3c7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.229051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1dd01-fc95-4791-bb6c-f7c93eecc3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.229318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1dd01-fc95-4791-bb6c-f7c93eecc3c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.229978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1dd01-fc95-4791-bb6c-f7c93eecc3c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:30.230277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1dd01-fc95-4791-bb6c-f7c93eecc3c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.231674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1dd01-fc95-4791-bb6c-f7c93eecc3c7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.239538 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:30.241214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 399/807] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:30.246968 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1dd01-fc95-4791-bb6c-f7c93eecc3c7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.300335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:30.352882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d15a-6b5b-4841-bb89-c5ac837844ac None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.354176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1dd01-fc95-4791-bb6c-f7c93eecc3c7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.413294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315b27-d62d-44c6-b215-ca36a2b0a6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.413926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315b27-d62d-44c6-b215-ca36a2b0a6d6 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.414203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315b27-d62d-44c6-b215-ca36a2b0a6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.414475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315b27-d62d-44c6-b215-ca36a2b0a6d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.416139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee5499-9ae1-4977-84ab-6a7e209e1825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.416770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee5499-9ae1-4977-84ab-6a7e209e1825 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.417040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee5499-9ae1-4977-84ab-6a7e209e1825 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.417303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee5499-9ae1-4977-84ab-6a7e209e1825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.435641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3315b27-d62d-44c6-b215-ca36a2b0a6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.437562 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3315b27-d62d-44c6-b215-ca36a2b0a6d6 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.439861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee5499-9ae1-4977-84ab-6a7e209e1825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.441285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee5499-9ae1-4977-84ab-6a7e209e1825 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-c3315b27-d62d-44c6-b215-ca36a2b0a6d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:30.461327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:30.462338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:30.463793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:30.463793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:30.463793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:30.463793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 400/808] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:30.470220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315b27-d62d-44c6-b215-ca36a2b0a6d6 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-7fee5499-9ae1-4977-84ab-6a7e209e1825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:30.472464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:30.473400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:30.474820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:30.474820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:30.474820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:30.474820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 409/809] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:30.483047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee5499-9ae1-4977-84ab-6a7e209e1825 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.606440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:30.621085 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee5499-9ae1-4977-84ab-6a7e209e1825 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.622271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315b27-d62d-44c6-b215-ca36a2b0a6d6 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.649740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:30.658055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da236de3-d0dc-40a7-b32b-cafae323150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.658704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da236de3-d0dc-40a7-b32b-cafae323150b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.659237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da236de3-d0dc-40a7-b32b-cafae323150b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.659529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da236de3-d0dc-40a7-b32b-cafae323150b None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.660278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da236de3-d0dc-40a7-b32b-cafae323150b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:30.660623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da236de3-d0dc-40a7-b32b-cafae323150b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.662084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da236de3-d0dc-40a7-b32b-cafae323150b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.663025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3675f-9069-46db-8249-c4a6ddc09e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.663831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3675f-9069-46db-8249-c4a6ddc09e3f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.664382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3675f-9069-46db-8249-c4a6ddc09e3f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.664878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3675f-9069-46db-8249-c4a6ddc09e3f None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.665813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3675f-9069-46db-8249-c4a6ddc09e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:30.666409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3675f-9069-46db-8249-c4a6ddc09e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.668110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3675f-9069-46db-8249-c4a6ddc09e3f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.682022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 401/810] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:30.682342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 410/811] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:30.683471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3675f-9069-46db-8249-c4a6ddc09e3f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.683581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7eada-1231-48de-ada7-1ae6e90a2b83 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.683858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7eada-1231-48de-ada7-1ae6e90a2b83 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.684131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7eada-1231-48de-ada7-1ae6e90a2b83 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.685612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 411/812] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:30.693801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ccd27-16b6-4d06-a0eb-3a953c0035d4 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.694045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ccd27-16b6-4d06-a0eb-3a953c0035d4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.694279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ccd27-16b6-4d06-a0eb-3a953c0035d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.713177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9e1ccd27-16b6-4d06-a0eb-3a953c0035d4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:30.714416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9e1ccd27-16b6-4d06-a0eb-3a953c0035d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:30.785516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 412/813] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:30.786281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ccd27-16b6-4d06-a0eb-3a953c0035d4 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.790980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3675f-9069-46db-8249-c4a6ddc09e3f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:30.828662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7700d-45e7-47c1-96ae-b7b58c44191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:30.829672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7700d-45e7-47c1-96ae-b7b58c44191a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:30.830153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7700d-45e7-47c1-96ae-b7b58c44191a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:30.830623 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7700d-45e7-47c1-96ae-b7b58c44191a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:30.838548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7700d-45e7-47c1-96ae-b7b58c44191a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:30.840344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7700d-45e7-47c1-96ae-b7b58c44191a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-aee7700d-45e7-47c1-96ae-b7b58c44191a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:30.853087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:30.854072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:33:30.855432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:30.857641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 402/814] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:30.863599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7700d-45e7-47c1-96ae-b7b58c44191a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:30.931161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:30.986223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7700d-45e7-47c1-96ae-b7b58c44191a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.024697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e9699-d4f0-4653-9afe-0c1ba0f67e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.025688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9699-d4f0-4653-9afe-0c1ba0f67e5e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.026170 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9699-d4f0-4653-9afe-0c1ba0f67e5e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.026646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9699-d4f0-4653-9afe-0c1ba0f67e5e None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.028028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e9699-d4f0-4653-9afe-0c1ba0f67e5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:31.028538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e9699-d4f0-4653-9afe-0c1ba0f67e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.030168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e9699-d4f0-4653-9afe-0c1ba0f67e5e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.043133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.049941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 403/815] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:31.059960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e9699-d4f0-4653-9afe-0c1ba0f67e5e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.077166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ccd27-16b6-4d06-a0eb-3a953c0035d4 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.139861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86547e44-374f-42f5-ab56-cb50900901e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.141334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86547e44-374f-42f5-ab56-cb50900901e4 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.141815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86547e44-374f-42f5-ab56-cb50900901e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.142286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86547e44-374f-42f5-ab56-cb50900901e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.150900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86547e44-374f-42f5-ab56-cb50900901e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.152636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86547e44-374f-42f5-ab56-cb50900901e4 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-86547e44-374f-42f5-ab56-cb50900901e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:31.165907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:31.166925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:31.167856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:31.170395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 413/816] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:33:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:31.171524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.171871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86547e44-374f-42f5-ab56-cb50900901e4 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.196980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e9699-d4f0-4653-9afe-0c1ba0f67e5e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.235949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd75d6-2add-490f-b774-7bb5439a7717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.236987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd75d6-2add-490f-b774-7bb5439a7717 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.237469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd75d6-2add-490f-b774-7bb5439a7717 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.237940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd75d6-2add-490f-b774-7bb5439a7717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.284707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86547e44-374f-42f5-ab56-cb50900901e4 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.320631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd75d6-2add-490f-b774-7bb5439a7717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.322659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd75d6-2add-490f-b774-7bb5439a7717 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.327599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64595ee-e7c4-4ea4-aa6e-241671f1fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.328247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64595ee-e7c4-4ea4-aa6e-241671f1fa29 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.328531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64595ee-e7c4-4ea4-aa6e-241671f1fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.328795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64595ee-e7c4-4ea4-aa6e-241671f1fa29 None admin] PATH_INFO: `/v3/services/network` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.329379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64595ee-e7c4-4ea4-aa6e-241671f1fa29 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.330754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64595ee-e7c4-4ea4-aa6e-241671f1fa29 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-f64595ee-e7c4-4ea4-aa6e-241671f1fa29 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:31.349686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:31.350788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 11:33:31.351643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:31.354888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 414/817] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:31.356060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64595ee-e7c4-4ea4-aa6e-241671f1fa29 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.362014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.441065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.469709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 404/818] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:33:31.470720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd75d6-2add-490f-b774-7bb5439a7717 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.498381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64595ee-e7c4-4ea4-aa6e-241671f1fa29 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.535662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b909c-03ac-4946-be9d-16a4b62ce9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.536274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b909c-03ac-4946-be9d-16a4b62ce9be None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.536555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b909c-03ac-4946-be9d-16a4b62ce9be None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.536832 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b909c-03ac-4946-be9d-16a4b62ce9be None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.537555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b909c-03ac-4946-be9d-16a4b62ce9be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:31.538082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b909c-03ac-4946-be9d-16a4b62ce9be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.539322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b909c-03ac-4946-be9d-16a4b62ce9be None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.558311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 415/819] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:31.563754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b909c-03ac-4946-be9d-16a4b62ce9be None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.596952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd75d6-2add-490f-b774-7bb5439a7717 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.626179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.638403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd82ed-9b35-453d-bce3-7ac781f0e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.639619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd82ed-9b35-453d-bce3-7ac781f0e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.640795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd82ed-9b35-453d-bce3-7ac781f0e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.641389 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd82ed-9b35-453d-bce3-7ac781f0e4c0 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.642241 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd82ed-9b35-453d-bce3-7ac781f0e4c0 None admin] RBAC: Adding query filter params (name=network) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:31.642787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd82ed-9b35-453d-bce3-7ac781f0e4c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.644379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd82ed-9b35-453d-bce3-7ac781f0e4c0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.649954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 405/820] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:31.651193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd82ed-9b35-453d-bce3-7ac781f0e4c0 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.675003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b909c-03ac-4946-be9d-16a4b62ce9be None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.704802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.723509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4512145-5a55-46b6-b197-eb50cf21d5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.724110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4512145-5a55-46b6-b197-eb50cf21d5ce None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.724435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4512145-5a55-46b6-b197-eb50cf21d5ce None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.724771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4512145-5a55-46b6-b197-eb50cf21d5ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.741596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4512145-5a55-46b6-b197-eb50cf21d5ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.743255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4512145-5a55-46b6-b197-eb50cf21d5ce None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-c4512145-5a55-46b6-b197-eb50cf21d5ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:31.762462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:31.763500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:31.765044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:31.765044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:31.765044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:31.765044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 416/821] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:31.765044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4512145-5a55-46b6-b197-eb50cf21d5ce None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.780446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd82ed-9b35-453d-bce3-7ac781f0e4c0 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.822005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e333eb8-1f99-482a-8f08-7ca5a70ca78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.823495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e333eb8-1f99-482a-8f08-7ca5a70ca78d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.824085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e333eb8-1f99-482a-8f08-7ca5a70ca78d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.824557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e333eb8-1f99-482a-8f08-7ca5a70ca78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.836354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e333eb8-1f99-482a-8f08-7ca5a70ca78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.838229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e333eb8-1f99-482a-8f08-7ca5a70ca78d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-6e333eb8-1f99-482a-8f08-7ca5a70ca78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:31.858527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:31.859917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:31.860853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:31.860853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:31.860853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:31.863192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 406/822] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:31.864295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e333eb8-1f99-482a-8f08-7ca5a70ca78d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.896154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4512145-5a55-46b6-b197-eb50cf21d5ce None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:31.913092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.946147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0474ef-053b-4785-a889-abce10d347d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:31.948438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0474ef-053b-4785-a889-abce10d347d1 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:31.949152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0474ef-053b-4785-a889-abce10d347d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:31.949835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0474ef-053b-4785-a889-abce10d347d1 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:31.951154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0474ef-053b-4785-a889-abce10d347d1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:31.951757 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0474ef-053b-4785-a889-abce10d347d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:31.954289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0474ef-053b-4785-a889-abce10d347d1 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:31.960569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 417/823] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:31.961950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0474ef-053b-4785-a889-abce10d347d1 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:31.990229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:31.997489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e333eb8-1f99-482a-8f08-7ca5a70ca78d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.037094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f6dd2-0675-4714-b516-5bea38e53e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.037878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6dd2-0675-4714-b516-5bea38e53e6a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.038260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6dd2-0675-4714-b516-5bea38e53e6a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.038631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f6dd2-0675-4714-b516-5bea38e53e6a None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.039471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f6dd2-0675-4714-b516-5bea38e53e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:32.039873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f6dd2-0675-4714-b516-5bea38e53e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.041551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f6dd2-0675-4714-b516-5bea38e53e6a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.058948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 407/824] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:32.059789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f6dd2-0675-4714-b516-5bea38e53e6a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.067062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0474ef-053b-4785-a889-abce10d347d1 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.105279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bb3a4-a182-468d-80fc-1fd387d5c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.106055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb3a4-a182-468d-80fc-1fd387d5c2d8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.106421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb3a4-a182-468d-80fc-1fd387d5c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.106705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb3a4-a182-468d-80fc-1fd387d5c2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.107405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bb3a4-a182-468d-80fc-1fd387d5c2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:32.107713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bb3a4-a182-468d-80fc-1fd387d5c2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.109864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bb3a4-a182-468d-80fc-1fd387d5c2d8 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.122753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 418/825] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:32.124036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723df3-3ab2-4e32-9ba8-389c989836a0 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.124329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723df3-3ab2-4e32-9ba8-389c989836a0 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.125135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723df3-3ab2-4e32-9ba8-389c989836a0 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.131287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 419/826] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:32.131287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723df3-3ab2-4e32-9ba8-389c989836a0 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.173591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.179557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f6dd2-0675-4714-b516-5bea38e53e6a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.262078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723df3-3ab2-4e32-9ba8-389c989836a0 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.299949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1ea39-f3b3-42ac-969f-533b5a899670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.300608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ea39-f3b3-42ac-969f-533b5a899670 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.300856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ea39-f3b3-42ac-969f-533b5a899670 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.301130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ea39-f3b3-42ac-969f-533b5a899670 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.308281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ea39-f3b3-42ac-969f-533b5a899670 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.309727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ea39-f3b3-42ac-969f-533b5a899670 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-57f1ea39-f3b3-42ac-969f-533b5a899670 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:32.321320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:32.322263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 420/827] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:32.323615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1ea39-f3b3-42ac-969f-533b5a899670 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.337299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa8556-5771-4433-bb7a-29ed9cb0d479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.337913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8556-5771-4433-bb7a-29ed9cb0d479 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.338202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8556-5771-4433-bb7a-29ed9cb0d479 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.338470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8556-5771-4433-bb7a-29ed9cb0d479 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.339166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa8556-5771-4433-bb7a-29ed9cb0d479 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.340528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa8556-5771-4433-bb7a-29ed9cb0d479 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.360326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 408/828] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:32 2022] POST /identity/v3/endpoints => generated 337 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:32.361559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707539ae-4bcb-4197-bc31-0bd910001a4f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.361843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707539ae-4bcb-4197-bc31-0bd910001a4f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.362113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707539ae-4bcb-4197-bc31-0bd910001a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.381626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-707539ae-4bcb-4197-bc31-0bd910001a4f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:32.382911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-707539ae-4bcb-4197-bc31-0bd910001a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:32.393148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.435708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.443689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1ea39-f3b3-42ac-969f-533b5a899670 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.475872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 409/829] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:32.477355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4402c2-f276-428f-b7d2-92add9a1f5a1 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.477646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4402c2-f276-428f-b7d2-92add9a1f5a1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.477919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4402c2-f276-428f-b7d2-92add9a1f5a1 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.483481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 410/830] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:32.483481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4402c2-f276-428f-b7d2-92add9a1f5a1 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.502722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fd31f-3001-47a0-90f0-fa2b374565b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.504209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fd31f-3001-47a0-90f0-fa2b374565b7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.504654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fd31f-3001-47a0-90f0-fa2b374565b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.505226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fd31f-3001-47a0-90f0-fa2b374565b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.517868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fd31f-3001-47a0-90f0-fa2b374565b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.520182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fd31f-3001-47a0-90f0-fa2b374565b7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-f92fd31f-3001-47a0-90f0-fa2b374565b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:32.535990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:32.537332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 421/831] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:32.538229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6ce59-c184-47a5-bab4-856dcf82fee5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.543220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6ce59-c184-47a5-bab4-856dcf82fee5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.543753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6ce59-c184-47a5-bab4-856dcf82fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.568535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f3f6ce59-c184-47a5-bab4-856dcf82fee5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:32.570875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f3f6ce59-c184-47a5-bab4-856dcf82fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:32.628665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4402c2-f276-428f-b7d2-92add9a1f5a1 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.654056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 422/832] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:32.655113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6ce59-c184-47a5-bab4-856dcf82fee5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.676455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10c5c6-42ab-4b08-9521-b7a5cab5a234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.677447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10c5c6-42ab-4b08-9521-b7a5cab5a234 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.677726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10c5c6-42ab-4b08-9521-b7a5cab5a234 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.677994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10c5c6-42ab-4b08-9521-b7a5cab5a234 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.678690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10c5c6-42ab-4b08-9521-b7a5cab5a234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:32.679040 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10c5c6-42ab-4b08-9521-b7a5cab5a234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.680462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10c5c6-42ab-4b08-9521-b7a5cab5a234 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.691920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.699276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 411/833] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:32.701647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10c5c6-42ab-4b08-9521-b7a5cab5a234 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.769995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.786695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6ce59-c184-47a5-bab4-856dcf82fee5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.813284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10c5c6-42ab-4b08-9521-b7a5cab5a234 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.825369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199f704-452e-4bc3-9cd8-941f19fe4f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.826073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199f704-452e-4bc3-9cd8-941f19fe4f1a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.826417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199f704-452e-4bc3-9cd8-941f19fe4f1a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.826758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199f704-452e-4bc3-9cd8-941f19fe4f1a None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.828209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199f704-452e-4bc3-9cd8-941f19fe4f1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:32.828580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199f704-452e-4bc3-9cd8-941f19fe4f1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.830154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199f704-452e-4bc3-9cd8-941f19fe4f1a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.842326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 423/834] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:32.847096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199f704-452e-4bc3-9cd8-941f19fe4f1a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.854298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e66f9e-e8cb-4644-9dac-769144d0118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:32.855189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e66f9e-e8cb-4644-9dac-769144d0118d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:32.855189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e66f9e-e8cb-4644-9dac-769144d0118d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:32.855465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e66f9e-e8cb-4644-9dac-769144d0118d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:32.856186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e66f9e-e8cb-4644-9dac-769144d0118d None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=46e2fac1066d4ad7b670d46f158fec97) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:32.856489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e66f9e-e8cb-4644-9dac-769144d0118d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:32.858019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e66f9e-e8cb-4644-9dac-769144d0118d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:32.864151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 412/835] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:32 2022] GET /identity/v3/role_assignments?user.id=46e2fac1066d4ad7b670d46f158fec97&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:32.864911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e66f9e-e8cb-4644-9dac-769144d0118d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:32.945354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.977882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199f704-452e-4bc3-9cd8-941f19fe4f1a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:32.990624 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e66f9e-e8cb-4644-9dac-769144d0118d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.020683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc72d8-b10b-4823-9ee3-80deb9afa2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.021447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc72d8-b10b-4823-9ee3-80deb9afa2b2 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.021723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc72d8-b10b-4823-9ee3-80deb9afa2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.021990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc72d8-b10b-4823-9ee3-80deb9afa2b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.035835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385e3b2-15eb-434c-b293-56481b401e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.036033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc72d8-b10b-4823-9ee3-80deb9afa2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:33.036137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385e3b2-15eb-434c-b293-56481b401e92 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.036137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385e3b2-15eb-434c-b293-56481b401e92 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.036137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385e3b2-15eb-434c-b293-56481b401e92 None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/1e97f5a53a9248438740d138d69596dd/roles/4631f2d361794b9e9e39f07bdc207d1e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-dccc72d8-b10b-4823-9ee3-80deb9afa2b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:33.041133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:33.042138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:33.043109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 424/836] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:33.044061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc72d8-b10b-4823-9ee3-80deb9afa2b2 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.053275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:33.063806 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385e3b2-15eb-434c-b293-56481b401e92 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=1e97f5a53a9248438740d138d69596dd, role_id=4631f2d361794b9e9e39f07bdc207d1e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.065718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385e3b2-15eb-434c-b293-56481b401e92 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.081503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 413/837] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:33:32 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/1e97f5a53a9248438740d138d69596dd/roles/4631f2d361794b9e9e39f07bdc207d1e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:33.082543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385e3b2-15eb-434c-b293-56481b401e92 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.183684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc72d8-b10b-4823-9ee3-80deb9afa2b2 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.224730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385e3b2-15eb-434c-b293-56481b401e92 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.241099 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:33.241755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9a1a-bed5-4bcc-905b-f3086eae9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.242658 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9a1a-bed5-4bcc-905b-f3086eae9929 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.243186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9a1a-bed5-4bcc-905b-f3086eae9929 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.243727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9a1a-bed5-4bcc-905b-f3086eae9929 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.244544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b9a1a-bed5-4bcc-905b-f3086eae9929 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.246281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b9a1a-bed5-4bcc-905b-f3086eae9929 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-640b9a1a-bed5-4bcc-905b-f3086eae9929 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:33.258990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:33.260273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:33:33.261102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:33.263570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 425/838] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:33.270119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94457656-842e-4f6b-876b-09ace74bb42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.271294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9a1a-bed5-4bcc-905b-f3086eae9929 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.271507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457656-842e-4f6b-876b-09ace74bb42a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.271802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457656-842e-4f6b-876b-09ace74bb42a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.272081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457656-842e-4f6b-876b-09ace74bb42a None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.272766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94457656-842e-4f6b-876b-09ace74bb42a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:33.273077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94457656-842e-4f6b-876b-09ace74bb42a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.274450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94457656-842e-4f6b-876b-09ace74bb42a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.286451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 414/839] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:33.293162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94457656-842e-4f6b-876b-09ace74bb42a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.369584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:33.412129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9a1a-bed5-4bcc-905b-f3086eae9929 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.440854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94457656-842e-4f6b-876b-09ace74bb42a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.453037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be3c74-1ea7-4884-89cc-79d04bbb845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.454044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be3c74-1ea7-4884-89cc-79d04bbb845b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.454262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be3c74-1ea7-4884-89cc-79d04bbb845b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.454507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be3c74-1ea7-4884-89cc-79d04bbb845b None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.455179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be3c74-1ea7-4884-89cc-79d04bbb845b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:33.455485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be3c74-1ea7-4884-89cc-79d04bbb845b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.456870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be3c74-1ea7-4884-89cc-79d04bbb845b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.469411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 426/840] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:33.470593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be3c74-1ea7-4884-89cc-79d04bbb845b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.487029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74a04-f005-45bc-98cf-cf3a5cc68688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.488555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74a04-f005-45bc-98cf-cf3a5cc68688 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.489125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74a04-f005-45bc-98cf-cf3a5cc68688 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.489607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74a04-f005-45bc-98cf-cf3a5cc68688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.505863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff74a04-f005-45bc-98cf-cf3a5cc68688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.507854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff74a04-f005-45bc-98cf-cf3a5cc68688 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-3ff74a04-f005-45bc-98cf-cf3a5cc68688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:33.528303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:33.529273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:33.530149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:33.530149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:33.530149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:33.539093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 415/841] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:33.539956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74a04-f005-45bc-98cf-cf3a5cc68688 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.574948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:33.614081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be3c74-1ea7-4884-89cc-79d04bbb845b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.659668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd259ce-0089-4795-8d1a-ab54b42d4a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.660553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd259ce-0089-4795-8d1a-ab54b42d4a5f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.660839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd259ce-0089-4795-8d1a-ab54b42d4a5f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.661114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd259ce-0089-4795-8d1a-ab54b42d4a5f None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.661918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd259ce-0089-4795-8d1a-ab54b42d4a5f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:33.662544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd259ce-0089-4795-8d1a-ab54b42d4a5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.664402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd259ce-0089-4795-8d1a-ab54b42d4a5f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.668535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74a04-f005-45bc-98cf-cf3a5cc68688 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.670854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 427/842] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:33.671979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:33.715901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdfade-e209-42d2-b875-fc749afa751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.716909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdfade-e209-42d2-b875-fc749afa751f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.717369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdfade-e209-42d2-b875-fc749afa751f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.717818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdfade-e209-42d2-b875-fc749afa751f None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.719352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdfade-e209-42d2-b875-fc749afa751f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:33.719850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdfade-e209-42d2-b875-fc749afa751f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.721464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdfade-e209-42d2-b875-fc749afa751f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.736665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 416/843] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:33.743963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd259ce-0089-4795-8d1a-ab54b42d4a5f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:33.869033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd259ce-0089-4795-8d1a-ab54b42d4a5f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:33.907160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edccda-bb1d-4598-b55d-623fbaed867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:33.907799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edccda-bb1d-4598-b55d-623fbaed867d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:33.908131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edccda-bb1d-4598-b55d-623fbaed867d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:33.908414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edccda-bb1d-4598-b55d-623fbaed867d None admin] PATH_INFO: `/v3/users/swift` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:33.916026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edccda-bb1d-4598-b55d-623fbaed867d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:33.917542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edccda-bb1d-4598-b55d-623fbaed867d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-d3edccda-bb1d-4598-b55d-623fbaed867d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:33.937681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:33.938896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:33.940107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 428/844] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:33.948510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdfade-e209-42d2-b875-fc749afa751f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.038438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:34.055750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdfade-e209-42d2-b875-fc749afa751f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:34.098977 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf1367-22f3-490f-853e-e25cb2944974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:34.099893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf1367-22f3-490f-853e-e25cb2944974 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.100358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf1367-22f3-490f-853e-e25cb2944974 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.100838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf1367-22f3-490f-853e-e25cb2944974 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.101755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf1367-22f3-490f-853e-e25cb2944974 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:34.102243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf1367-22f3-490f-853e-e25cb2944974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:34.103926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf1367-22f3-490f-853e-e25cb2944974 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:34.123767 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 417/845] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 11:33:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:34.131893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edccda-bb1d-4598-b55d-623fbaed867d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.197074 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:34.243629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edccda-bb1d-4598-b55d-623fbaed867d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:34.278983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a173d-d722-4889-a4cd-cf68bc6cdd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:34.279597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a173d-d722-4889-a4cd-cf68bc6cdd9c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.279878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a173d-d722-4889-a4cd-cf68bc6cdd9c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.280150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a173d-d722-4889-a4cd-cf68bc6cdd9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.354165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a173d-d722-4889-a4cd-cf68bc6cdd9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:34.355665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a173d-d722-4889-a4cd-cf68bc6cdd9c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:34.415606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:34.460890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 429/846] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:34 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:33:34.466173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf1367-22f3-490f-853e-e25cb2944974 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.571722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf1367-22f3-490f-853e-e25cb2944974 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:34.609477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f219858-0d45-402f-91db-b3656ff23579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:34.610658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f219858-0d45-402f-91db-b3656ff23579 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.611190 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f219858-0d45-402f-91db-b3656ff23579 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.611674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f219858-0d45-402f-91db-b3656ff23579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.622498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f219858-0d45-402f-91db-b3656ff23579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:34.624224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f219858-0d45-402f-91db-b3656ff23579 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:34.632061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-1f219858-0d45-402f-91db-b3656ff23579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:34.641092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:34.642483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:34.643626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:34.643626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:34.643626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:34.645573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 418/847] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:34.650930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a173d-d722-4889-a4cd-cf68bc6cdd9c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.761236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a173d-d722-4889-a4cd-cf68bc6cdd9c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:34.798271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e794f-539e-416a-869c-08b943cf8098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:34.798918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e794f-539e-416a-869c-08b943cf8098 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.799196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e794f-539e-416a-869c-08b943cf8098 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.799525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e794f-539e-416a-869c-08b943cf8098 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.800241 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e794f-539e-416a-869c-08b943cf8098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:34.800545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e794f-539e-416a-869c-08b943cf8098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:34.801911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e794f-539e-416a-869c-08b943cf8098 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:34.815264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 430/848] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:34.822600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f219858-0d45-402f-91db-b3656ff23579 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:34.934876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a73e5-d379-4e34-ba4b-fe4647650a33 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.935501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a73e5-d379-4e34-ba4b-fe4647650a33 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.936021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a73e5-d379-4e34-ba4b-fe4647650a33 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.942676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 431/849] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:34.944900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38d7f-7780-4752-8df9-9dcc57ff7503 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.945392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38d7f-7780-4752-8df9-9dcc57ff7503 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.945865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38d7f-7780-4752-8df9-9dcc57ff7503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:34.956245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f219858-0d45-402f-91db-b3656ff23579 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:34.966135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-20e38d7f-7780-4752-8df9-9dcc57ff7503 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:34.967636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-20e38d7f-7780-4752-8df9-9dcc57ff7503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:34.988435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:34.995835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3c58d-258b-4805-a2a3-d00b74ec327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:34.996481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3c58d-258b-4805-a2a3-d00b74ec327c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:34.996764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3c58d-258b-4805-a2a3-d00b74ec327c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:34.997060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3c58d-258b-4805-a2a3-d00b74ec327c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.006345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3c58d-258b-4805-a2a3-d00b74ec327c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:35.008350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3c58d-258b-4805-a2a3-d00b74ec327c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-37c3c58d-258b-4805-a2a3-d00b74ec327c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:35.021901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:35.022802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:35.024131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:35.024131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:35.024131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:35.024131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:35.024131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:35.024131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:35.024131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:35.024131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:35.024131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 419/850] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:35.030186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3c58d-258b-4805-a2a3-d00b74ec327c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.067729 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 432/851] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:35.117508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:35.167378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3c58d-258b-4805-a2a3-d00b74ec327c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.205447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb09a-99ff-47e0-a240-f0de2c2a190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.206060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb09a-99ff-47e0-a240-f0de2c2a190b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.206341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb09a-99ff-47e0-a240-f0de2c2a190b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.206889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb09a-99ff-47e0-a240-f0de2c2a190b None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.207553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb09a-99ff-47e0-a240-f0de2c2a190b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:35.207857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb09a-99ff-47e0-a240-f0de2c2a190b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:35.209152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc59d9-48e3-4480-9b95-01f9c35b3269 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.209335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb09a-99ff-47e0-a240-f0de2c2a190b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:35.209808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc59d9-48e3-4480-9b95-01f9c35b3269 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.210298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc59d9-48e3-4480-9b95-01f9c35b3269 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.212157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 433/852] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:35.217714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad56ee5-8a92-4c41-aafd-11f24d1455cb None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.218812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad56ee5-8a92-4c41-aafd-11f24d1455cb None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.219395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad56ee5-8a92-4c41-aafd-11f24d1455cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.223270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 420/853] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:35.228737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb09a-99ff-47e0-a240-f0de2c2a190b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.240157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-fad56ee5-8a92-4c41-aafd-11f24d1455cb None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:35.241360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-fad56ee5-8a92-4c41-aafd-11f24d1455cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:35.318872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 434/854] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:35.345579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb09a-99ff-47e0-a240-f0de2c2a190b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.368198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:35.383199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15c6f-30ba-409e-a573-1460fae2396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.383619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad56ee5-8a92-4c41-aafd-11f24d1455cb None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.383818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15c6f-30ba-409e-a573-1460fae2396c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.384105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15c6f-30ba-409e-a573-1460fae2396c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.384376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15c6f-30ba-409e-a573-1460fae2396c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.385366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15c6f-30ba-409e-a573-1460fae2396c None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=d81a9aefdc6c4ada9baca8097927c03a) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:35.385673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15c6f-30ba-409e-a573-1460fae2396c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:35.387122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15c6f-30ba-409e-a573-1460fae2396c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:35.394179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 421/855] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:35 2022] GET /identity/v3/role_assignments?user.id=d81a9aefdc6c4ada9baca8097927c03a&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:35.492339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:35.525469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad56ee5-8a92-4c41-aafd-11f24d1455cb None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.565776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1672f-68dc-441d-9d44-62bb6c875995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.566493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1672f-68dc-441d-9d44-62bb6c875995 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.566795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1672f-68dc-441d-9d44-62bb6c875995 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.567075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1672f-68dc-441d-9d44-62bb6c875995 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.567668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1672f-68dc-441d-9d44-62bb6c875995 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:35.569093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1672f-68dc-441d-9d44-62bb6c875995 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-8ff1672f-68dc-441d-9d44-62bb6c875995 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:35.578932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:35.579915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:35.580810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 435/856] 10.222.0.59 () {56 vars in 1132 bytes} [Wed Aug 24 11:33:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:35.586421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15c6f-30ba-409e-a573-1460fae2396c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.604024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1672f-68dc-441d-9d44-62bb6c875995 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.709978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15c6f-30ba-409e-a573-1460fae2396c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.746444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd28d87-22f7-4c51-a260-b34d360beaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.747094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd28d87-22f7-4c51-a260-b34d360beaa3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.747375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd28d87-22f7-4c51-a260-b34d360beaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.747648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd28d87-22f7-4c51-a260-b34d360beaa3 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.748279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd28d87-22f7-4c51-a260-b34d360beaa3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:35.748582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd28d87-22f7-4c51-a260-b34d360beaa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:35.749994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd28d87-22f7-4c51-a260-b34d360beaa3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:35.754672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 422/857] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:35.755882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d2a72-b667-4f2b-8c4c-3fe4df2366c4 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.756169 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d2a72-b667-4f2b-8c4c-3fe4df2366c4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.756444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d2a72-b667-4f2b-8c4c-3fe4df2366c4 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.761720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 423/858] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:35.761851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1672f-68dc-441d-9d44-62bb6c875995 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.762229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d2a72-b667-4f2b-8c4c-3fe4df2366c4 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.801497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a835f-2988-4875-b491-aec0462fbb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.802154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a835f-2988-4875-b491-aec0462fbb3b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.802433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a835f-2988-4875-b491-aec0462fbb3b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.802704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a835f-2988-4875-b491-aec0462fbb3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.815944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a835f-2988-4875-b491-aec0462fbb3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:35.817718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-697a835f-2988-4875-b491-aec0462fbb3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:35.821928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:35.823434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 436/859] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:35.824569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856a7a-218e-46a4-92e0-aaf3dba1805d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.825296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856a7a-218e-46a4-92e0-aaf3dba1805d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.825296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856a7a-218e-46a4-92e0-aaf3dba1805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.831295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:35.845630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6f856a7a-218e-46a4-92e0-aaf3dba1805d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:35.846973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6f856a7a-218e-46a4-92e0-aaf3dba1805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:35.884331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d2a72-b667-4f2b-8c4c-3fe4df2366c4 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:35.921941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b0b4a-3b0a-4213-8ad1-558d8a7e52f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:35.922587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b0b4a-3b0a-4213-8ad1-558d8a7e52f9 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:35.927042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 437/860] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:35.927145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b0b4a-3b0a-4213-8ad1-558d8a7e52f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:35.927145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b0b4a-3b0a-4213-8ad1-558d8a7e52f9 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:35.927284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f856a7a-218e-46a4-92e0-aaf3dba1805d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:35.927367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b0b4a-3b0a-4213-8ad1-558d8a7e52f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:35.927367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b0b4a-3b0a-4213-8ad1-558d8a7e52f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:35.927367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b0b4a-3b0a-4213-8ad1-558d8a7e52f9 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:35.942609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 424/861] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:36.058612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f856a7a-218e-46a4-92e0-aaf3dba1805d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:36.101770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:36.109511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7820-96d9-4e98-afdf-c32c3350a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:36.110136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7820-96d9-4e98-afdf-c32c3350a0ad None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:36.110444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7820-96d9-4e98-afdf-c32c3350a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:36.110691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7820-96d9-4e98-afdf-c32c3350a0ad None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:36.111398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7820-96d9-4e98-afdf-c32c3350a0ad None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:36.111765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7820-96d9-4e98-afdf-c32c3350a0ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:36.113150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7820-96d9-4e98-afdf-c32c3350a0ad None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:36.122662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 438/862] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:36.128185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b0b4a-3b0a-4213-8ad1-558d8a7e52f9 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:36.195845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7820-96d9-4e98-afdf-c32c3350a0ad None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:36.241379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b0b4a-3b0a-4213-8ad1-558d8a7e52f9 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:36.255149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:36.279400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197f1f-39ec-4ec9-a943-8e7c4a4b4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:36.280032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197f1f-39ec-4ec9-a943-8e7c4a4b4a94 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:36.280309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197f1f-39ec-4ec9-a943-8e7c4a4b4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:36.280716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197f1f-39ec-4ec9-a943-8e7c4a4b4a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:36.292220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13197f1f-39ec-4ec9-a943-8e7c4a4b4a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:36.293959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13197f1f-39ec-4ec9-a943-8e7c4a4b4a94 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-13197f1f-39ec-4ec9-a943-8e7c4a4b4a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:36.308418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:36.309420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:36.310315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:36.310315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:36.310315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:36.314351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7820-96d9-4e98-afdf-c32c3350a0ad None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:36.315248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 425/863] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:36.316547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197f1f-39ec-4ec9-a943-8e7c4a4b4a94 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:36.351418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88e4e-359f-4bb4-b8e6-8966169c297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:36.352606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88e4e-359f-4bb4-b8e6-8966169c297d None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:36.353101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88e4e-359f-4bb4-b8e6-8966169c297d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:36.353623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88e4e-359f-4bb4-b8e6-8966169c297d None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:36.354480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88e4e-359f-4bb4-b8e6-8966169c297d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:36.356239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88e4e-359f-4bb4-b8e6-8966169c297d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:36.375652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 439/864] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:33:36 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:33:36.443406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197f1f-39ec-4ec9-a943-8e7c4a4b4a94 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:36.491967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6cd7a-5e41-4d0a-8b6c-55305e698d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:36.492584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6cd7a-5e41-4d0a-8b6c-55305e698d49 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:36.492858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6cd7a-5e41-4d0a-8b6c-55305e698d49 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:36.493127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6cd7a-5e41-4d0a-8b6c-55305e698d49 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:36.493775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6cd7a-5e41-4d0a-8b6c-55305e698d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:36.494073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6cd7a-5e41-4d0a-8b6c-55305e698d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:36.495564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6cd7a-5e41-4d0a-8b6c-55305e698d49 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:36.510695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 426/865] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:36.519939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88e4e-359f-4bb4-b8e6-8966169c297d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:36.582094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:36.632174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88e4e-359f-4bb4-b8e6-8966169c297d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:36.670214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994cce1-029e-4784-95b9-274f4d34451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:36.670883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994cce1-029e-4784-95b9-274f4d34451a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:36.671691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994cce1-029e-4784-95b9-274f4d34451a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:36.672022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994cce1-029e-4784-95b9-274f4d34451a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:36.680122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994cce1-029e-4784-95b9-274f4d34451a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:36.681566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994cce1-029e-4784-95b9-274f4d34451a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-9994cce1-029e-4784-95b9-274f4d34451a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:36.693247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:36.694173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:36.695465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 440/866] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:33:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:36.700011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6cd7a-5e41-4d0a-8b6c-55305e698d49 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:36.720779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:36.808814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6cd7a-5e41-4d0a-8b6c-55305e698d49 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:36.844737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec2012-d040-4dd3-ab25-0bdf3cef7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:36.845347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec2012-d040-4dd3-ab25-0bdf3cef7a7c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:36.845627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec2012-d040-4dd3-ab25-0bdf3cef7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:36.845897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec2012-d040-4dd3-ab25-0bdf3cef7a7c None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:36.846688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec2012-d040-4dd3-ab25-0bdf3cef7a7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:36.847026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec2012-d040-4dd3-ab25-0bdf3cef7a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:36.848517 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec2012-d040-4dd3-ab25-0bdf3cef7a7c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:36.867779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 427/867] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 11:33:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:36.873105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994cce1-029e-4784-95b9-274f4d34451a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:36.983047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994cce1-029e-4784-95b9-274f4d34451a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:36.999684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:37.020613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dfdb4-2877-44f0-9b9b-6239a922bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:37.021282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dfdb4-2877-44f0-9b9b-6239a922bbdb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.021569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dfdb4-2877-44f0-9b9b-6239a922bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.021846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dfdb4-2877-44f0-9b9b-6239a922bbdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.100457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107dfdb4-2877-44f0-9b9b-6239a922bbdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:37.101940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107dfdb4-2877-44f0-9b9b-6239a922bbdb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:37.218500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 441/868] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:36 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:33:37.223766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec2012-d040-4dd3-ab25-0bdf3cef7a7c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:37.304927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:37.336836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec2012-d040-4dd3-ab25-0bdf3cef7a7c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:37.373087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151d931-6c1d-446f-a332-878a12ca6261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:37.373717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151d931-6c1d-446f-a332-878a12ca6261 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.373993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151d931-6c1d-446f-a332-878a12ca6261 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.374819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151d931-6c1d-446f-a332-878a12ca6261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.385673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151d931-6c1d-446f-a332-878a12ca6261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:37.387228 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151d931-6c1d-446f-a332-878a12ca6261 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-8151d931-6c1d-446f-a332-878a12ca6261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:37.402166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:37.403187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:37.404715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:37.404715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:37.404715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:37.404715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 428/869] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:37.409208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dfdb4-2877-44f0-9b9b-6239a922bbdb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:37.425252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:37.514724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dfdb4-2877-44f0-9b9b-6239a922bbdb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:37.542797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6631a-fe2e-4cef-9f14-1500d56b4126 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.543104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6631a-fe2e-4cef-9f14-1500d56b4126 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.543360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6631a-fe2e-4cef-9f14-1500d56b4126 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.545008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 429/870] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:37.551092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac27d2b-95f3-44e6-95b9-c0f36a5b292a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.551416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac27d2b-95f3-44e6-95b9-c0f36a5b292a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.551672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac27d2b-95f3-44e6-95b9-c0f36a5b292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.555110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc418765-5732-4ca9-b0f8-6f8e77fad4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:37.555733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc418765-5732-4ca9-b0f8-6f8e77fad4b8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.556015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc418765-5732-4ca9-b0f8-6f8e77fad4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.556289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc418765-5732-4ca9-b0f8-6f8e77fad4b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.556946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc418765-5732-4ca9-b0f8-6f8e77fad4b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:37.557247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc418765-5732-4ca9-b0f8-6f8e77fad4b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:37.558659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc418765-5732-4ca9-b0f8-6f8e77fad4b8 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:37.572442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 442/871] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:37.578223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-fac27d2b-95f3-44e6-95b9-c0f36a5b292a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:37.578428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc418765-5732-4ca9-b0f8-6f8e77fad4b8 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:37.579607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fac27d2b-95f3-44e6-95b9-c0f36a5b292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:37.651816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 430/872] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:37.669734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:37.698260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc418765-5732-4ca9-b0f8-6f8e77fad4b8 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:37.734601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046259e-19ad-4abb-a91a-78a36b6c15c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:37.735611 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046259e-19ad-4abb-a91a-78a36b6c15c1 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.736150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046259e-19ad-4abb-a91a-78a36b6c15c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.736641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046259e-19ad-4abb-a91a-78a36b6c15c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.744065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046259e-19ad-4abb-a91a-78a36b6c15c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:37.745847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046259e-19ad-4abb-a91a-78a36b6c15c1 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-3046259e-19ad-4abb-a91a-78a36b6c15c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:37.757922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:37.758879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:37.759776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:37.759776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:37.759776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:37.759776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:37.759776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:37.759776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:37.759776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:37.759776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:37.762425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 443/873] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:37.768114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac27d2b-95f3-44e6-95b9-c0f36a5b292a None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:37.831476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:37.878513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac27d2b-95f3-44e6-95b9-c0f36a5b292a None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:37.915417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42f0f-6fcb-4ae7-a532-ef3f8f54c00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:37.916027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42f0f-6fcb-4ae7-a532-ef3f8f54c00e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:37.916302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42f0f-6fcb-4ae7-a532-ef3f8f54c00e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:37.916576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42f0f-6fcb-4ae7-a532-ef3f8f54c00e None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:37.917265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42f0f-6fcb-4ae7-a532-ef3f8f54c00e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:37.917563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42f0f-6fcb-4ae7-a532-ef3f8f54c00e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:37.919014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42f0f-6fcb-4ae7-a532-ef3f8f54c00e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:37.922952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046259e-19ad-4abb-a91a-78a36b6c15c1 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:37.932015 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 431/874] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:37.938539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42f0f-6fcb-4ae7-a532-ef3f8f54c00e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.039424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046259e-19ad-4abb-a91a-78a36b6c15c1 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.041945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42f0f-6fcb-4ae7-a532-ef3f8f54c00e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.059663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:38.078477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08bd3-e892-41ab-8553-3f0180f2c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.079127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08bd3-e892-41ab-8553-3f0180f2c884 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.079706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08bd3-e892-41ab-8553-3f0180f2c884 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.079980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08bd3-e892-41ab-8553-3f0180f2c884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.080708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08bd3-e892-41ab-8553-3f0180f2c884 None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=1e97f5a53a9248438740d138d69596dd) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:38.081013 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08bd3-e892-41ab-8553-3f0180f2c884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.082497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08bd3-e892-41ab-8553-3f0180f2c884 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.082877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f073970-2796-49f0-8b73-d3e154f4f311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.083516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f073970-2796-49f0-8b73-d3e154f4f311 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.083798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f073970-2796-49f0-8b73-d3e154f4f311 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.084075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f073970-2796-49f0-8b73-d3e154f4f311 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.084769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f073970-2796-49f0-8b73-d3e154f4f311 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.086128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f073970-2796-49f0-8b73-d3e154f4f311 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.088048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:38.090940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 432/875] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:37 2022] GET /identity/v3/role_assignments?user.id=1e97f5a53a9248438740d138d69596dd&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:38.092666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ad78b-9b66-417a-aaaa-fc26168103dd None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.094439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ad78b-9b66-417a-aaaa-fc26168103dd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.094982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ad78b-9b66-417a-aaaa-fc26168103dd None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-2f073970-2796-49f0-8b73-d3e154f4f311 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:38.096326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:38.097303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:38.098157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:38.099920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 433/876] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:38.105701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 444/877] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:38.106605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1bf16-4029-4996-a7e3-0b541a242095 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.106923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1bf16-4029-4996-a7e3-0b541a242095 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.107198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1bf16-4029-4996-a7e3-0b541a242095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.111865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f073970-2796-49f0-8b73-d3e154f4f311 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.132528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-1db1bf16-4029-4996-a7e3-0b541a242095 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:38.134498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1db1bf16-4029-4996-a7e3-0b541a242095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:38.245636 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 434/878] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:38.247359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f073970-2796-49f0-8b73-d3e154f4f311 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.288109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389abf9-76e3-48e9-8ced-f27a91c74a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.289051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389abf9-76e3-48e9-8ced-f27a91c74a48 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.289598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389abf9-76e3-48e9-8ced-f27a91c74a48 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.290055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389abf9-76e3-48e9-8ced-f27a91c74a48 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.290894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389abf9-76e3-48e9-8ced-f27a91c74a48 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:38.291382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389abf9-76e3-48e9-8ced-f27a91c74a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.293004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389abf9-76e3-48e9-8ced-f27a91c74a48 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.301001 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 445/879] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:38.306309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1bf16-4029-4996-a7e3-0b541a242095 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.428091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1bf16-4029-4996-a7e3-0b541a242095 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.440519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:38.455001 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961833c7-343e-494a-8457-bc4d39de0303 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.455309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961833c7-343e-494a-8457-bc4d39de0303 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.455549 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961833c7-343e-494a-8457-bc4d39de0303 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.457149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 446/880] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:38.462127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a42a-9c88-448b-8005-a366c5a8538d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.462408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a42a-9c88-448b-8005-a366c5a8538d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.462680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a42a-9c88-448b-8005-a366c5a8538d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.466575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a60d1-54e5-481e-8b9a-dde762e0422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.467224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a60d1-54e5-481e-8b9a-dde762e0422a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.467603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a60d1-54e5-481e-8b9a-dde762e0422a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.467889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a60d1-54e5-481e-8b9a-dde762e0422a None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.468872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a60d1-54e5-481e-8b9a-dde762e0422a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:38.469202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a60d1-54e5-481e-8b9a-dde762e0422a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.470567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a60d1-54e5-481e-8b9a-dde762e0422a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.475823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 435/881] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:38.481883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-2e92a42a-9c88-448b-8005-a366c5a8538d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:38.485469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-2e92a42a-9c88-448b-8005-a366c5a8538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:38.533602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a60d1-54e5-481e-8b9a-dde762e0422a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.554523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:38.568202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 447/882] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:38.666045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a60d1-54e5-481e-8b9a-dde762e0422a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:38.703987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddefb7-95a2-436a-bef2-a9dff69ad59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:38.704611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddefb7-95a2-436a-bef2-a9dff69ad59e None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:38.704891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddefb7-95a2-436a-bef2-a9dff69ad59e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:38.705165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddefb7-95a2-436a-bef2-a9dff69ad59e None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:38.705817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddefb7-95a2-436a-bef2-a9dff69ad59e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:38.707284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddefb7-95a2-436a-bef2-a9dff69ad59e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:38.726651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 436/883] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:33:38 2022] POST /identity/v3/services => generated 269 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:33:38.842431 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a42a-9c88-448b-8005-a366c5a8538d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:38.958505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a42a-9c88-448b-8005-a366c5a8538d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.001624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f59572-455b-4bf2-8eb9-b86798b1019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.002733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f59572-455b-4bf2-8eb9-b86798b1019e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.003240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f59572-455b-4bf2-8eb9-b86798b1019e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.003734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f59572-455b-4bf2-8eb9-b86798b1019e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.004461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f59572-455b-4bf2-8eb9-b86798b1019e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.005971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f59572-455b-4bf2-8eb9-b86798b1019e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-61f59572-455b-4bf2-8eb9-b86798b1019e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:39.015425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:39.016543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:33:39.017558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:39.019970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 448/884] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:33:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:39.025948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddefb7-95a2-436a-bef2-a9dff69ad59e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:39.063727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:39.135658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddefb7-95a2-436a-bef2-a9dff69ad59e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.175461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eec72-9fdc-42d2-935e-832a8e0004e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.176254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eec72-9fdc-42d2-935e-832a8e0004e3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.176605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eec72-9fdc-42d2-935e-832a8e0004e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.176943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eec72-9fdc-42d2-935e-832a8e0004e3 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.177648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eec72-9fdc-42d2-935e-832a8e0004e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:39.178021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eec72-9fdc-42d2-935e-832a8e0004e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.179466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eec72-9fdc-42d2-935e-832a8e0004e3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.184828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 437/885] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:33:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:39.191330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f59572-455b-4bf2-8eb9-b86798b1019e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:39.254917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:39.306745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f59572-455b-4bf2-8eb9-b86798b1019e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.343993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e6a8d-39af-4630-8023-6b634070f3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.344632 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e6a8d-39af-4630-8023-6b634070f3cc None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.344914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e6a8d-39af-4630-8023-6b634070f3cc None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.345190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e6a8d-39af-4630-8023-6b634070f3cc None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.345845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e6a8d-39af-4630-8023-6b634070f3cc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:39.346154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e6a8d-39af-4630-8023-6b634070f3cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.347586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e6a8d-39af-4630-8023-6b634070f3cc None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.353626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 449/886] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:33:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:39.359080 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eec72-9fdc-42d2-935e-832a8e0004e3 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:39.461816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:39.465763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eec72-9fdc-42d2-935e-832a8e0004e3 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.508487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9261f4-6b05-43b5-8223-f3159ebfbbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.509095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9261f4-6b05-43b5-8223-f3159ebfbbe2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.509370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9261f4-6b05-43b5-8223-f3159ebfbbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.509636 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9261f4-6b05-43b5-8223-f3159ebfbbe2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.510585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9261f4-6b05-43b5-8223-f3159ebfbbe2 None admin] RBAC: Adding query filter params (interface=public, service_id=d5302d13f26648088cb64005c108e362, region_id=RegionOne) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:39.510916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9261f4-6b05-43b5-8223-f3159ebfbbe2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.512256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9261f4-6b05-43b5-8223-f3159ebfbbe2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.518419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 438/887] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 11:33:39 2022] GET /identity/v3/endpoints?service_id=d5302d13f26648088cb64005c108e362&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:39.523834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e6a8d-39af-4630-8023-6b634070f3cc None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:39.633843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e6a8d-39af-4630-8023-6b634070f3cc None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:39.652014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:39.672036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f6ec4-fc6d-4474-9efd-29f08f0da016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:39.672761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f6ec4-fc6d-4474-9efd-29f08f0da016 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:39.673034 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f6ec4-fc6d-4474-9efd-29f08f0da016 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:39.673305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f6ec4-fc6d-4474-9efd-29f08f0da016 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:39.673913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f6ec4-fc6d-4474-9efd-29f08f0da016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:39.675315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f6ec4-fc6d-4474-9efd-29f08f0da016 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:39.681878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 450/888] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 11:33:39 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:33:40.224815 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0ab91-8493-4ae0-80e5-e054f6f2d1c0 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.225036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0ab91-8493-4ae0-80e5-e054f6f2d1c0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.225258 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0ab91-8493-4ae0-80e5-e054f6f2d1c0 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.226936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 439/889] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:40.232447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d47a-e00a-4c2b-aa84-0b148d02602a None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.232738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d47a-e00a-4c2b-aa84-0b148d02602a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.233018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d47a-e00a-4c2b-aa84-0b148d02602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.252957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-3e07d47a-e00a-4c2b-aa84-0b148d02602a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:40.254168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3e07d47a-e00a-4c2b-aa84-0b148d02602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.329477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 451/890] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:40.565397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25790d-354f-4380-a20d-f9931dfed8ce None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.566036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25790d-354f-4380-a20d-f9931dfed8ce None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.566036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25790d-354f-4380-a20d-f9931dfed8ce None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.567635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 440/891] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:40.573096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353403c-dab5-4c90-9a1a-06164ba2c3a0 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.573667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353403c-dab5-4c90-9a1a-06164ba2c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.574135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353403c-dab5-4c90-9a1a-06164ba2c3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.595363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-7353403c-dab5-4c90-9a1a-06164ba2c3a0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:40.597087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7353403c-dab5-4c90-9a1a-06164ba2c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.599989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25790d-354f-4380-a20d-f9931dfed8ce None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:40.687413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 452/892] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:40.721442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25790d-354f-4380-a20d-f9931dfed8ce None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:40.757978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038404c-89c4-4049-a7ba-fc9857b3f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:40.758683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038404c-89c4-4049-a7ba-fc9857b3f176 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.759086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038404c-89c4-4049-a7ba-fc9857b3f176 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.759392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038404c-89c4-4049-a7ba-fc9857b3f176 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.772110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038404c-89c4-4049-a7ba-fc9857b3f176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-9038404c-89c4-4049-a7ba-fc9857b3f176 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:40.776955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:40.777867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:33:40.778690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:40.782960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 441/893] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 11:33:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:40.784704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353403c-dab5-4c90-9a1a-06164ba2c3a0 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:40.831262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:40.849482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8d60-109c-4d1b-9399-4d3c2b247167 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.849810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8d60-109c-4d1b-9399-4d3c2b247167 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.850031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8d60-109c-4d1b-9399-4d3c2b247167 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.851816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 442/894] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:40.859405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8e82a-97f9-4300-9972-22370ebe7098 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.859874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8e82a-97f9-4300-9972-22370ebe7098 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.860302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8e82a-97f9-4300-9972-22370ebe7098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.881777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b7f8e82a-97f9-4300-9972-22370ebe7098 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:40.883385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b7f8e82a-97f9-4300-9972-22370ebe7098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:40.902171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:40.904195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353403c-dab5-4c90-9a1a-06164ba2c3a0 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:40.944730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccb5f-8a0f-4027-bfe1-be479b911d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:40.945349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccb5f-8a0f-4027-bfe1-be479b911d74 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:40.945637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccb5f-8a0f-4027-bfe1-be479b911d74 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:40.945924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ccb5f-8a0f-4027-bfe1-be479b911d74 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:40.946784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ccb5f-8a0f-4027-bfe1-be479b911d74 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:40.947094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ccb5f-8a0f-4027-bfe1-be479b911d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:40.948740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ccb5f-8a0f-4027-bfe1-be479b911d74 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:40.963173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 453/895] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 11:33:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:40.964687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccb5f-8a0f-4027-bfe1-be479b911d74 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:40.974589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 443/896] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:41.010683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8e82a-97f9-4300-9972-22370ebe7098 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.092252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ccb5f-8a0f-4027-bfe1-be479b911d74 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.095683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:41.138802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309005-1b7d-43de-a4c9-c4678b307d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.138802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309005-1b7d-43de-a4c9-c4678b307d11 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.138802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309005-1b7d-43de-a4c9-c4678b307d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.138802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309005-1b7d-43de-a4c9-c4678b307d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.139227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8e82a-97f9-4300-9972-22370ebe7098 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.150364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0309005-1b7d-43de-a4c9-c4678b307d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.151995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0309005-1b7d-43de-a4c9-c4678b307d11 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-c0309005-1b7d-43de-a4c9-c4678b307d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:41.170603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:41.172180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:41.173043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:41.173043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:41.173043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:41.173043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 454/897] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:41.179165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309005-1b7d-43de-a4c9-c4678b307d11 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.180561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328251-090f-4754-8606-0b74a432b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.181195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328251-090f-4754-8606-0b74a432b137 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.181485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328251-090f-4754-8606-0b74a432b137 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.181765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328251-090f-4754-8606-0b74a432b137 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.182423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66328251-090f-4754-8606-0b74a432b137 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.183844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66328251-090f-4754-8606-0b74a432b137 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.202408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 444/898] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:33:41 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:33:41.268708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328251-090f-4754-8606-0b74a432b137 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.296175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:41.324603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309005-1b7d-43de-a4c9-c4678b307d11 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.385746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a19c-a037-4394-95bc-6dfeb54a3df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.386399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a19c-a037-4394-95bc-6dfeb54a3df6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.386676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a19c-a037-4394-95bc-6dfeb54a3df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.387035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a19c-a037-4394-95bc-6dfeb54a3df6 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.387785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a19c-a037-4394-95bc-6dfeb54a3df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:41.388091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a19c-a037-4394-95bc-6dfeb54a3df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.389458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a19c-a037-4394-95bc-6dfeb54a3df6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.403400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 455/899] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:41.410067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328251-090f-4754-8606-0b74a432b137 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.410713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a19c-a037-4394-95bc-6dfeb54a3df6 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.425363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:41.454792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b6bf5-4a04-4232-b966-ea12889532d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.455611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b6bf5-4a04-4232-b966-ea12889532d4 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.456723 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b6bf5-4a04-4232-b966-ea12889532d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.457014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b6bf5-4a04-4232-b966-ea12889532d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.457620 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b6bf5-4a04-4232-b966-ea12889532d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.459087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b6bf5-4a04-4232-b966-ea12889532d4 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-999b6bf5-4a04-4232-b966-ea12889532d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:41.471500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:41.472454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:41.473343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 445/900] 10.222.0.59 () {56 vars in 1132 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:41.479863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b6bf5-4a04-4232-b966-ea12889532d4 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.542922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a19c-a037-4394-95bc-6dfeb54a3df6 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.568831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:41.595662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2876de-524d-47c6-8e7c-99ed22f35e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.596301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2876de-524d-47c6-8e7c-99ed22f35e20 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.596576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2876de-524d-47c6-8e7c-99ed22f35e20 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.596847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2876de-524d-47c6-8e7c-99ed22f35e20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.597462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b6bf5-4a04-4232-b966-ea12889532d4 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.606258 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2876de-524d-47c6-8e7c-99ed22f35e20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.607755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2876de-524d-47c6-8e7c-99ed22f35e20 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-4b2876de-524d-47c6-8e7c-99ed22f35e20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:41.627678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:41.628703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:41.629646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:41.630173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 456/901] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:41.636225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2876de-524d-47c6-8e7c-99ed22f35e20 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.643004 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71193d27-003f-45fb-997d-546f24f63973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.643849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71193d27-003f-45fb-997d-546f24f63973 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.644302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71193d27-003f-45fb-997d-546f24f63973 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.644770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71193d27-003f-45fb-997d-546f24f63973 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.645569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71193d27-003f-45fb-997d-546f24f63973 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:41.646043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71193d27-003f-45fb-997d-546f24f63973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.647694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71193d27-003f-45fb-997d-546f24f63973 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.657394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 446/902] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:41.657851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7246315-73b7-448b-9f30-ff762c4dc34d None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.658442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7246315-73b7-448b-9f30-ff762c4dc34d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.658747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7246315-73b7-448b-9f30-ff762c4dc34d None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.660734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 447/903] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:41.661371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7246315-73b7-448b-9f30-ff762c4dc34d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.719237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:41.758412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2876de-524d-47c6-8e7c-99ed22f35e20 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.778994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7246315-73b7-448b-9f30-ff762c4dc34d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.793528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db960b-653d-4a9a-9659-c323be0fa832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.794365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db960b-653d-4a9a-9659-c323be0fa832 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.794475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db960b-653d-4a9a-9659-c323be0fa832 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.794664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db960b-653d-4a9a-9659-c323be0fa832 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.795425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db960b-653d-4a9a-9659-c323be0fa832 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:41.795749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db960b-653d-4a9a-9659-c323be0fa832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.797713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db960b-653d-4a9a-9659-c323be0fa832 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.817637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 457/904] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:41.817852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643fcf2-d983-4b50-a784-87e31ff7af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.818376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643fcf2-d983-4b50-a784-87e31ff7af38 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.818651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643fcf2-d983-4b50-a784-87e31ff7af38 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.818749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe8a0-208e-47c1-afa2-da909ce82dd2 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.818948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643fcf2-d983-4b50-a784-87e31ff7af38 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.819060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe8a0-208e-47c1-afa2-da909ce82dd2 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.819315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe8a0-208e-47c1-afa2-da909ce82dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:41.819570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643fcf2-d983-4b50-a784-87e31ff7af38 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:41.819869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643fcf2-d983-4b50-a784-87e31ff7af38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:41.821219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643fcf2-d983-4b50-a784-87e31ff7af38 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:41.827996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 448/905] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:41.828452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643fcf2-d983-4b50-a784-87e31ff7af38 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.833210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:41.844002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-116fe8a0-208e-47c1-afa2-da909ce82dd2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:41.844997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-116fe8a0-208e-47c1-afa2-da909ce82dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:41.925544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 458/906] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:41.926354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fe8a0-208e-47c1-afa2-da909ce82dd2 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:41.953054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643fcf2-d983-4b50-a784-87e31ff7af38 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:41.990913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d56f5-7301-4aae-886e-912437f3d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:41.991508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d56f5-7301-4aae-886e-912437f3d3ce None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:41.991783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d56f5-7301-4aae-886e-912437f3d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:41.992060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d56f5-7301-4aae-886e-912437f3d3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.015153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.058631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fe8a0-208e-47c1-afa2-da909ce82dd2 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.068042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d56f5-7301-4aae-886e-912437f3d3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.069559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d56f5-7301-4aae-886e-912437f3d3ce None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.072260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.101047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58234f-7776-4939-8715-23bd17a92a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.101770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58234f-7776-4939-8715-23bd17a92a80 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.102049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58234f-7776-4939-8715-23bd17a92a80 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.102322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58234f-7776-4939-8715-23bd17a92a80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.103050 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58234f-7776-4939-8715-23bd17a92a80 None admin] RBAC: Adding query filter params (interface=public, service_id=9e49816e576d4b159ab10ce12e390853, region_id=RegionOne) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:42.103360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58234f-7776-4939-8715-23bd17a92a80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.104923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58234f-7776-4939-8715-23bd17a92a80 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.115864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 459/907] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/endpoints?service_id=9e49816e576d4b159ab10ce12e390853&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:42.116755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58234f-7776-4939-8715-23bd17a92a80 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.180014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 449/908] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:41 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:33:42.185267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d56f5-7301-4aae-886e-912437f3d3ce None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.234747 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58234f-7776-4939-8715-23bd17a92a80 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.266097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.286799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6a948-5f7e-4e8d-bc57-30542b1c3191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.286799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6a948-5f7e-4e8d-bc57-30542b1c3191 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.286799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6a948-5f7e-4e8d-bc57-30542b1c3191 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.286799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6a948-5f7e-4e8d-bc57-30542b1c3191 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.287229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6a948-5f7e-4e8d-bc57-30542b1c3191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.287229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6a948-5f7e-4e8d-bc57-30542b1c3191 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.289115 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 460/909] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:42.289935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6a948-5f7e-4e8d-bc57-30542b1c3191 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.328736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d56f5-7301-4aae-886e-912437f3d3ce None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.331826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.374469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc24fe2-8a28-4303-8d60-e8cf01083299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.375519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc24fe2-8a28-4303-8d60-e8cf01083299 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.375889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc24fe2-8a28-4303-8d60-e8cf01083299 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.376230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc24fe2-8a28-4303-8d60-e8cf01083299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.394131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc24fe2-8a28-4303-8d60-e8cf01083299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.395811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc24fe2-8a28-4303-8d60-e8cf01083299 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-cdc24fe2-8a28-4303-8d60-e8cf01083299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:42.422731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:42.423836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:42.424734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:42.424734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:42.424734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:42.424734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 450/910] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:42.431993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc24fe2-8a28-4303-8d60-e8cf01083299 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.434455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6a948-5f7e-4e8d-bc57-30542b1c3191 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.477364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831a0bb-7247-497d-b84d-cb55ef48dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.478007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831a0bb-7247-497d-b84d-cb55ef48dbd3 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.478290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831a0bb-7247-497d-b84d-cb55ef48dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.478564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831a0bb-7247-497d-b84d-cb55ef48dbd3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.480176 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831a0bb-7247-497d-b84d-cb55ef48dbd3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.480567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831a0bb-7247-497d-b84d-cb55ef48dbd3 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-2831a0bb-7247-497d-b84d-cb55ef48dbd3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:42.493408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:42.494630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 11:33:42.495742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:42.496705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 461/911] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:42.503709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831a0bb-7247-497d-b84d-cb55ef48dbd3 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.567240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc24fe2-8a28-4303-8d60-e8cf01083299 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.569456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.611983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c7823-300d-425b-9d63-3553839402f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.612621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c7823-300d-425b-9d63-3553839402f2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.613033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c7823-300d-425b-9d63-3553839402f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.613397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c7823-300d-425b-9d63-3553839402f2 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.614122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c7823-300d-425b-9d63-3553839402f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:42.614495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c7823-300d-425b-9d63-3553839402f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.616000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c7823-300d-425b-9d63-3553839402f2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.630927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 451/912] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:42.638337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c7823-300d-425b-9d63-3553839402f2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.651700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831a0bb-7247-497d-b84d-cb55ef48dbd3 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.664811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.692889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f29a2e-532a-44c4-9201-79b379f86914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.693541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f29a2e-532a-44c4-9201-79b379f86914 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.693891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f29a2e-532a-44c4-9201-79b379f86914 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.694237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f29a2e-532a-44c4-9201-79b379f86914 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.694996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f29a2e-532a-44c4-9201-79b379f86914 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:42.695469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f29a2e-532a-44c4-9201-79b379f86914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.696933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f29a2e-532a-44c4-9201-79b379f86914 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.703732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 462/913] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:42.709061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f29a2e-532a-44c4-9201-79b379f86914 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.773236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c7823-300d-425b-9d63-3553839402f2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.815377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2eb94e-6e7e-4a8c-8de1-0c30da7398d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.816396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eb94e-6e7e-4a8c-8de1-0c30da7398d6 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.816883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eb94e-6e7e-4a8c-8de1-0c30da7398d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.817449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eb94e-6e7e-4a8c-8de1-0c30da7398d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.821184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f29a2e-532a-44c4-9201-79b379f86914 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:42.826237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2eb94e-6e7e-4a8c-8de1-0c30da7398d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.829424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2eb94e-6e7e-4a8c-8de1-0c30da7398d6 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-4d2eb94e-6e7e-4a8c-8de1-0c30da7398d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:42.844833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:42.845786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:42.846665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:42.846665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:42.846665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:42.846665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:42.846665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:42.846665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:42.846665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:42.846665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:42.847730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.854026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 452/914] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:42.855943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2eb94e-6e7e-4a8c-8de1-0c30da7398d6 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.859314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c269-b17c-41bf-aa34-0bb7ee4d60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:42.859919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c269-b17c-41bf-aa34-0bb7ee4d60bf None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:42.860200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c269-b17c-41bf-aa34-0bb7ee4d60bf None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:42.860474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c269-b17c-41bf-aa34-0bb7ee4d60bf None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:42.861115 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c269-b17c-41bf-aa34-0bb7ee4d60bf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:42.861421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c269-b17c-41bf-aa34-0bb7ee4d60bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:42.862831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c269-b17c-41bf-aa34-0bb7ee4d60bf None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:42.872909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 463/915] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:42.873964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c269-b17c-41bf-aa34-0bb7ee4d60bf None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:42.967552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:42.998534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c269-b17c-41bf-aa34-0bb7ee4d60bf None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:43.000272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2eb94e-6e7e-4a8c-8de1-0c30da7398d6 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:43.036026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1e13-1715-4330-9b1b-33851aceee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:43.036634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1e13-1715-4330-9b1b-33851aceee48 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.036907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1e13-1715-4330-9b1b-33851aceee48 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.037177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1e13-1715-4330-9b1b-33851aceee48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.037836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1e13-1715-4330-9b1b-33851aceee48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:43.039364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1e13-1715-4330-9b1b-33851aceee48 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:43.046718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3166a1-78dd-4d40-8a61-d499770377e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:43.047901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3166a1-78dd-4d40-8a61-d499770377e7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.048405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3166a1-78dd-4d40-8a61-d499770377e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.048873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3166a1-78dd-4d40-8a61-d499770377e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.049933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3166a1-78dd-4d40-8a61-d499770377e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:43.050440 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3166a1-78dd-4d40-8a61-d499770377e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:43.052075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3166a1-78dd-4d40-8a61-d499770377e7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:43.075041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 464/916] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:43.078203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 453/917] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:43.087330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1e13-1715-4330-9b1b-33851aceee48 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:43.136601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:43.224199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1e13-1715-4330-9b1b-33851aceee48 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:43.263465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c6fd6-9fb7-483b-8c36-f2ebb8bde25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:43.264086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6fd6-9fb7-483b-8c36-f2ebb8bde25e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.264364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6fd6-9fb7-483b-8c36-f2ebb8bde25e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.264785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6fd6-9fb7-483b-8c36-f2ebb8bde25e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.265730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c6fd6-9fb7-483b-8c36-f2ebb8bde25e None admin] RBAC: Adding query filter params (role.id=3d0b905c684f446b892eae2d95c4a6cf, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=1e97f5a53a9248438740d138d69596dd) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:43.266040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c6fd6-9fb7-483b-8c36-f2ebb8bde25e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:43.267512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c6fd6-9fb7-483b-8c36-f2ebb8bde25e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:43.269885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ae655-b742-444a-85fb-5cb72c609cc2 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.270171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ae655-b742-444a-85fb-5cb72c609cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.270439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ae655-b742-444a-85fb-5cb72c609cc2 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.271844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 454/918] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:43.277337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f61d4-7c69-4472-9d90-4ed34e5cffeb None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.277617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f61d4-7c69-4472-9d90-4ed34e5cffeb None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.277889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f61d4-7c69-4472-9d90-4ed34e5cffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.278066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 465/919] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:43 2022] GET /identity/v3/role_assignments?user.id=1e97f5a53a9248438740d138d69596dd&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=3d0b905c684f446b892eae2d95c4a6cf => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:43.298426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-343f61d4-7c69-4472-9d90-4ed34e5cffeb None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:43.299694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-343f61d4-7c69-4472-9d90-4ed34e5cffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:43.380064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 455/920] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:43.666377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c6fd6-9fb7-483b-8c36-f2ebb8bde25e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:43.770262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:43.778173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c6fd6-9fb7-483b-8c36-f2ebb8bde25e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:43.813370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cbb5e-d40b-4ff3-81e1-faee676f804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:43.814275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cbb5e-d40b-4ff3-81e1-faee676f804e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.814859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cbb5e-d40b-4ff3-81e1-faee676f804e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.815381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cbb5e-d40b-4ff3-81e1-faee676f804e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.816222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cbb5e-d40b-4ff3-81e1-faee676f804e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:43.817939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cbb5e-d40b-4ff3-81e1-faee676f804e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-6f2cbb5e-d40b-4ff3-81e1-faee676f804e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:43.828087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:43.829820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:43.831043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:43.833730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 466/921] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:43.839383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f61d4-7c69-4472-9d90-4ed34e5cffeb None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:43.913152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:43.957546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f61d4-7c69-4472-9d90-4ed34e5cffeb None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:43.995938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b651-b74a-484c-9e38-6693b3efab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:43.996556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b651-b74a-484c-9e38-6693b3efab67 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:43.996961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b651-b74a-484c-9e38-6693b3efab67 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:43.997360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b651-b74a-484c-9e38-6693b3efab67 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:43.998124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761b651-b74a-484c-9e38-6693b3efab67 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:43.998427 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761b651-b74a-484c-9e38-6693b3efab67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.001004 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761b651-b74a-484c-9e38-6693b3efab67 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.006758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 456/922] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:44.012733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cbb5e-d40b-4ff3-81e1-faee676f804e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.118278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cbb5e-d40b-4ff3-81e1-faee676f804e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.154364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03be05-6f94-4ca2-9c50-cf39af07869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.155008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03be05-6f94-4ca2-9c50-cf39af07869e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.155958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03be05-6f94-4ca2-9c50-cf39af07869e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.156235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03be05-6f94-4ca2-9c50-cf39af07869e None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.156867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03be05-6f94-4ca2-9c50-cf39af07869e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:44.157207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03be05-6f94-4ca2-9c50-cf39af07869e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.158570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03be05-6f94-4ca2-9c50-cf39af07869e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.164117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 467/923] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:44.169812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b651-b74a-484c-9e38-6693b3efab67 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.284676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b651-b74a-484c-9e38-6693b3efab67 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.317086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:44.323418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7bdb-1291-4e03-a25f-3876381901f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.324053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7bdb-1291-4e03-a25f-3876381901f7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.324343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7bdb-1291-4e03-a25f-3876381901f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.324737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7bdb-1291-4e03-a25f-3876381901f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.325459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c7bdb-1291-4e03-a25f-3876381901f7 None admin] RBAC: Adding query filter params (interface=public, service_id=d9d946b2e6814f66adad6a55fdb97de9, region_id=RegionOne) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:44.325869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c7bdb-1291-4e03-a25f-3876381901f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.328714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c7bdb-1291-4e03-a25f-3876381901f7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.334800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 457/924] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/endpoints?service_id=d9d946b2e6814f66adad6a55fdb97de9&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:44.340692 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03be05-6f94-4ca2-9c50-cf39af07869e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.373755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:44.424564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6594a3-2057-459a-817e-a27084003dd7 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.424927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6594a3-2057-459a-817e-a27084003dd7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.425128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6594a3-2057-459a-817e-a27084003dd7 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.426661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 458/925] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:44.432033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901339-896b-4590-a1e9-76d8236c0f75 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.432317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901339-896b-4590-a1e9-76d8236c0f75 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.432588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901339-896b-4590-a1e9-76d8236c0f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.453792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d6901339-896b-4590-a1e9-76d8236c0f75 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:44.455085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d6901339-896b-4590-a1e9-76d8236c0f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:44.460155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03be05-6f94-4ca2-9c50-cf39af07869e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.499515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a3d2-4903-4b3d-9ecc-9aaf4f162c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.500509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a3d2-4903-4b3d-9ecc-9aaf4f162c6a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.501134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a3d2-4903-4b3d-9ecc-9aaf4f162c6a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.501475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a3d2-4903-4b3d-9ecc-9aaf4f162c6a None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.502152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5a3d2-4903-4b3d-9ecc-9aaf4f162c6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.503641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5a3d2-4903-4b3d-9ecc-9aaf4f162c6a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.519082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 468/926] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:44.537990 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 459/927] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:44.816827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a3d2-4903-4b3d-9ecc-9aaf4f162c6a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:44.917038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:44.946499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a3d2-4903-4b3d-9ecc-9aaf4f162c6a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:44.984779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f802caa-f073-4648-aad0-8632dc47a0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:44.985260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f802caa-f073-4648-aad0-8632dc47a0f6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:44.985545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f802caa-f073-4648-aad0-8632dc47a0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:44.985817 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f802caa-f073-4648-aad0-8632dc47a0f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:44.986403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f802caa-f073-4648-aad0-8632dc47a0f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:44.987859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f802caa-f073-4648-aad0-8632dc47a0f6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-3f802caa-f073-4648-aad0-8632dc47a0f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:44.996756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:44.997713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:44.998638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 469/928] 10.222.0.59 () {56 vars in 1132 bytes} [Wed Aug 24 11:33:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:45.004735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6901339-896b-4590-a1e9-76d8236c0f75 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.110384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6901339-896b-4590-a1e9-76d8236c0f75 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.135997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:45.148430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07871104-99e5-4c5e-88f7-bd9e7433f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.149107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07871104-99e5-4c5e-88f7-bd9e7433f05d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.149391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07871104-99e5-4c5e-88f7-bd9e7433f05d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.149663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07871104-99e5-4c5e-88f7-bd9e7433f05d None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.150304 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07871104-99e5-4c5e-88f7-bd9e7433f05d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:45.150607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07871104-99e5-4c5e-88f7-bd9e7433f05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.152003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07871104-99e5-4c5e-88f7-bd9e7433f05d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.157550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 460/929] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:45.163370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f802caa-f073-4648-aad0-8632dc47a0f6 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.211455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087e22f-9334-48fe-aad3-45aa729b5b6f None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.211784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087e22f-9334-48fe-aad3-45aa729b5b6f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.211988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087e22f-9334-48fe-aad3-45aa729b5b6f None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.214569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 461/930] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:45.219664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70095-6216-42ec-a500-c492e8109138 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.219950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70095-6216-42ec-a500-c492e8109138 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.220226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70095-6216-42ec-a500-c492e8109138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.238528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-dfd70095-6216-42ec-a500-c492e8109138 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:45.239766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-dfd70095-6216-42ec-a500-c492e8109138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:45.290056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f802caa-f073-4648-aad0-8632dc47a0f6 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.317150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 462/931] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:45.318592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b277a-440e-43bd-8bea-f9ee7ab29c4b None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.318914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b277a-440e-43bd-8bea-f9ee7ab29c4b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.319189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b277a-440e-43bd-8bea-f9ee7ab29c4b None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.320575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 463/932] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:45.325707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130202e5-44d6-4e66-8179-d462214b90a7 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.325995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130202e5-44d6-4e66-8179-d462214b90a7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.326266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130202e5-44d6-4e66-8179-d462214b90a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.336039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df08453-6147-4983-bb6e-918ad99e25bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.337216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df08453-6147-4983-bb6e-918ad99e25bc None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.337718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df08453-6147-4983-bb6e-918ad99e25bc None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.338308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df08453-6147-4983-bb6e-918ad99e25bc None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.339457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df08453-6147-4983-bb6e-918ad99e25bc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:45.339973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df08453-6147-4983-bb6e-918ad99e25bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.341721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df08453-6147-4983-bb6e-918ad99e25bc None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.345787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-130202e5-44d6-4e66-8179-d462214b90a7 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:45.347084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-130202e5-44d6-4e66-8179-d462214b90a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:45.348536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 470/933] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:45.353683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df08453-6147-4983-bb6e-918ad99e25bc None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.371672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:45.438338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 464/934] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:45.473331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df08453-6147-4983-bb6e-918ad99e25bc None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.508604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d33d5b-800a-4a3c-8a90-520598926a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.509573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33d5b-800a-4a3c-8a90-520598926a34 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.510301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33d5b-800a-4a3c-8a90-520598926a34 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.510824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33d5b-800a-4a3c-8a90-520598926a34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.511694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d33d5b-800a-4a3c-8a90-520598926a34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.513237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d33d5b-800a-4a3c-8a90-520598926a34 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.535695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 471/935] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:33:45.615531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130202e5-44d6-4e66-8179-d462214b90a7 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.682228 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:45.737521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130202e5-44d6-4e66-8179-d462214b90a7 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.743161 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d33d5b-800a-4a3c-8a90-520598926a34 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.789883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.790494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.790791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.791068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.791714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:45.793135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:45.796348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WARNING keystone.server.flask.common [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 11:33:45.815428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.sql.core [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 11:33:45.815428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 11:33:45.815428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [parameters: {'id': '1b1cf0b5c4a94076b7bb00a9e815fd3d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 11:33:45.815428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 11:33:45.831787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1b1cf0b5c4a94076b7bb00a9e815fd3d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1b1cf0b5c4a94076b7bb00a9e815fd3d. Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:33:45.836581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application result.read() Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 11:33:45.837417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application yield resource Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise self.value Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application session.commit() Aug 24 11:33:45.838547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.session.flush() Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application compat.raise_( Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 11:33:45.839471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 11:33:45.840541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application result.read() Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:33:45.841385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [parameters: {'id': '1b1cf0b5c4a94076b7bb00a9e815fd3d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:45.842249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:45.844789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1b1cf0b5c4a94076b7bb00a9e815fd3d. Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:45.845793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 465/936] 10.222.0.59 () {60 vars in 1140 bytes} [Wed Aug 24 11:33:45 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:45.854900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:45.867730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d33d5b-800a-4a3c-8a90-520598926a34 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:45.909310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8105a30-0d9d-47f5-ba3c-dc9bd0a35d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:45.909968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8105a30-0d9d-47f5-ba3c-dc9bd0a35d56 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:45.910250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8105a30-0d9d-47f5-ba3c-dc9bd0a35d56 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:45.910579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8105a30-0d9d-47f5-ba3c-dc9bd0a35d56 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:45.923941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8105a30-0d9d-47f5-ba3c-dc9bd0a35d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-d8105a30-0d9d-47f5-ba3c-dc9bd0a35d56 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:45.929845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:45.931780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:45.932879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 472/937] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 11:33:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:45.943659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8105a30-0d9d-47f5-ba3c-dc9bd0a35d56 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.004319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:46.009801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae7446-9eca-4218-b196-40d0bffed56c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.061837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bb2a1-d8eb-4f9c-93b5-37f8368d0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.062677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bb2a1-d8eb-4f9c-93b5-37f8368d0705 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.062981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bb2a1-d8eb-4f9c-93b5-37f8368d0705 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.063257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bb2a1-d8eb-4f9c-93b5-37f8368d0705 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.073441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bb2a1-d8eb-4f9c-93b5-37f8368d0705 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.075859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bb2a1-d8eb-4f9c-93b5-37f8368d0705 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.079380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8105a30-0d9d-47f5-ba3c-dc9bd0a35d56 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-9f3bb2a1-d8eb-4f9c-93b5-37f8368d0705 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:46.091138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:46.092115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:46.093664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:46.093664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:46.093664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:46.093664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:46.093664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:46.093664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:46.093664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:46.093664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:46.098151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 466/938] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:46.099447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bb2a1-d8eb-4f9c-93b5-37f8368d0705 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.119383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:46.127194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a093c94-b251-4303-afe8-afa9324041be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.128155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a093c94-b251-4303-afe8-afa9324041be None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.128654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a093c94-b251-4303-afe8-afa9324041be None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.129159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a093c94-b251-4303-afe8-afa9324041be None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.130053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a093c94-b251-4303-afe8-afa9324041be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:46.130555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a093c94-b251-4303-afe8-afa9324041be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.132181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a093c94-b251-4303-afe8-afa9324041be None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.147175 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 473/939] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 11:33:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:46.148854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a093c94-b251-4303-afe8-afa9324041be None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.225574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bb2a1-d8eb-4f9c-93b5-37f8368d0705 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.267168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d2291-39ce-443d-ae2f-dd6d7cf83aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.268178 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d2291-39ce-443d-ae2f-dd6d7cf83aa3 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.268687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d2291-39ce-443d-ae2f-dd6d7cf83aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.269173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d2291-39ce-443d-ae2f-dd6d7cf83aa3 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.270107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d2291-39ce-443d-ae2f-dd6d7cf83aa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:46.270309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a093c94-b251-4303-afe8-afa9324041be None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.270831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d2291-39ce-443d-ae2f-dd6d7cf83aa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.272708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d2291-39ce-443d-ae2f-dd6d7cf83aa3 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.295261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 467/940] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:46.316814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d659d-dcaa-4de1-b2be-1bb96991b070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.317853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d659d-dcaa-4de1-b2be-1bb96991b070 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.318354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d659d-dcaa-4de1-b2be-1bb96991b070 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.318893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d659d-dcaa-4de1-b2be-1bb96991b070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.332862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d659d-dcaa-4de1-b2be-1bb96991b070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.334780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d659d-dcaa-4de1-b2be-1bb96991b070 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-a87d659d-dcaa-4de1-b2be-1bb96991b070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:46.351373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:46.352424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:46.353305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:46.353305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:46.353305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:46.359581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 474/941] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:46.362313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d2291-39ce-443d-ae2f-dd6d7cf83aa3 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.391169 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:46.479812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d2291-39ce-443d-ae2f-dd6d7cf83aa3 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.518127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f696-cd4a-4075-a20a-4ceea5562893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.518739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f696-cd4a-4075-a20a-4ceea5562893 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.519098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f696-cd4a-4075-a20a-4ceea5562893 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.519377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f696-cd4a-4075-a20a-4ceea5562893 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.520020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f696-cd4a-4075-a20a-4ceea5562893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:46.520323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f696-cd4a-4075-a20a-4ceea5562893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.521693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f696-cd4a-4075-a20a-4ceea5562893 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.535111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 468/942] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:46.540422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d659d-dcaa-4de1-b2be-1bb96991b070 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.591641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:46.661175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a931fff-99f3-41d8-9339-69b40787cdc2 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.661379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d659d-dcaa-4de1-b2be-1bb96991b070 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.661497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a931fff-99f3-41d8-9339-69b40787cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.661725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a931fff-99f3-41d8-9339-69b40787cdc2 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.663524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 469/943] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:46.670845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a0576-edcf-459a-8da1-6dbe06315d5c None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.671311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a0576-edcf-459a-8da1-6dbe06315d5c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.671884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a0576-edcf-459a-8da1-6dbe06315d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.694752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-879a0576-edcf-459a-8da1-6dbe06315d5c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:46.696328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-879a0576-edcf-459a-8da1-6dbe06315d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:46.711168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2793-f74d-4234-8235-397dae0b792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.711810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2793-f74d-4234-8235-397dae0b792c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.712093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2793-f74d-4234-8235-397dae0b792c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.712366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2793-f74d-4234-8235-397dae0b792c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.721557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f2793-f74d-4234-8235-397dae0b792c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.723042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f2793-f74d-4234-8235-397dae0b792c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-7d5f2793-f74d-4234-8235-397dae0b792c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:46.736774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:46.737951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:46.739066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 475/944] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:33:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:46.743863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2793-f74d-4234-8235-397dae0b792c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.786610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 470/945] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:46.866507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2793-f74d-4234-8235-397dae0b792c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:46.868925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:46.905012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65df7c-64f8-44c8-8b77-037fad453702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:46.905654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65df7c-64f8-44c8-8b77-037fad453702 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:46.905934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65df7c-64f8-44c8-8b77-037fad453702 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:46.906206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65df7c-64f8-44c8-8b77-037fad453702 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:46.907010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65df7c-64f8-44c8-8b77-037fad453702 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:46.907315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65df7c-64f8-44c8-8b77-037fad453702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:46.908735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65df7c-64f8-44c8-8b77-037fad453702 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:46.930999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 476/946] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 11:33:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:46.938541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a0576-edcf-459a-8da1-6dbe06315d5c None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:46.967150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:47.065842 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a0576-edcf-459a-8da1-6dbe06315d5c None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.084910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65df7c-64f8-44c8-8b77-037fad453702 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.105370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c28c5-8a9d-4338-ba4b-c3776c2e2140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.106968 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c28c5-8a9d-4338-ba4b-c3776c2e2140 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.107661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c28c5-8a9d-4338-ba4b-c3776c2e2140 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.108269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c28c5-8a9d-4338-ba4b-c3776c2e2140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.122642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c28c5-8a9d-4338-ba4b-c3776c2e2140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.125019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c28c5-8a9d-4338-ba4b-c3776c2e2140 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-976c28c5-8a9d-4338-ba4b-c3776c2e2140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:47.145810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:47.146854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:47.147754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:47.147754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:47.147754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:47.153062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 471/947] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:47.154549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c28c5-8a9d-4338-ba4b-c3776c2e2140 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.210200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65df7c-64f8-44c8-8b77-037fad453702 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.221906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:47.248281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a0855-22e8-48e2-9e78-e22e80d32d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.249372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a0855-22e8-48e2-9e78-e22e80d32d73 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.249864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a0855-22e8-48e2-9e78-e22e80d32d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.250352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a0855-22e8-48e2-9e78-e22e80d32d73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.251175 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a0855-22e8-48e2-9e78-e22e80d32d73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.252740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a0855-22e8-48e2-9e78-e22e80d32d73 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-3f0a0855-22e8-48e2-9e78-e22e80d32d73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:47.262875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:47.263901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:47.265485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:47.266243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c28c5-8a9d-4338-ba4b-c3776c2e2140 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.272991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 477/948] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:47.274472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a0855-22e8-48e2-9e78-e22e80d32d73 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.303240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c295658-fa01-4153-a51e-c51c92ff0931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.303837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c295658-fa01-4153-a51e-c51c92ff0931 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.304049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c295658-fa01-4153-a51e-c51c92ff0931 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.304320 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c295658-fa01-4153-a51e-c51c92ff0931 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.305068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c295658-fa01-4153-a51e-c51c92ff0931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:47.305369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c295658-fa01-4153-a51e-c51c92ff0931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.306130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:47.306909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c295658-fa01-4153-a51e-c51c92ff0931 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.325264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 472/949] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:47.327954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c295658-fa01-4153-a51e-c51c92ff0931 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.411598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a0855-22e8-48e2-9e78-e22e80d32d73 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.445425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c295658-fa01-4153-a51e-c51c92ff0931 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.448961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088d438-8047-4eb9-8de9-1cf5436ad5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.449468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088d438-8047-4eb9-8de9-1cf5436ad5e5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.449848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088d438-8047-4eb9-8de9-1cf5436ad5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.450262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088d438-8047-4eb9-8de9-1cf5436ad5e5 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.451094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088d438-8047-4eb9-8de9-1cf5436ad5e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:47.451496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088d438-8047-4eb9-8de9-1cf5436ad5e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.453728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088d438-8047-4eb9-8de9-1cf5436ad5e5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.464007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 478/950] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:47.465667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088d438-8047-4eb9-8de9-1cf5436ad5e5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.479058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:47.496623 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d14fe6-b4db-4051-93de-bd172abf542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.497362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d14fe6-b4db-4051-93de-bd172abf542c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.498290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d14fe6-b4db-4051-93de-bd172abf542c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.498646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d14fe6-b4db-4051-93de-bd172abf542c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.509836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d14fe6-b4db-4051-93de-bd172abf542c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.511895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d14fe6-b4db-4051-93de-bd172abf542c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-78d14fe6-b4db-4051-93de-bd172abf542c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:47.531663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:47.532655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:47.533568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:47.533568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:47.533568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:47.533568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:47.533568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:47.533568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:47.533568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:47.533568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:47.534837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 473/951] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:47.538545 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d14fe6-b4db-4051-93de-bd172abf542c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.600009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:47.612320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088d438-8047-4eb9-8de9-1cf5436ad5e5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.650625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61f9f1-8463-4516-b976-5d05969c9410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.651627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61f9f1-8463-4516-b976-5d05969c9410 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.652107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61f9f1-8463-4516-b976-5d05969c9410 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.652654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61f9f1-8463-4516-b976-5d05969c9410 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.653502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61f9f1-8463-4516-b976-5d05969c9410 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:47.654152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61f9f1-8463-4516-b976-5d05969c9410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.656631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61f9f1-8463-4516-b976-5d05969c9410 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.667392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d14fe6-b4db-4051-93de-bd172abf542c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.667718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 479/952] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:47.668856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61f9f1-8463-4516-b976-5d05969c9410 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.702720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cdfb6-e476-4543-b050-7fa480169a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.703353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cdfb6-e476-4543-b050-7fa480169a1b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.703630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cdfb6-e476-4543-b050-7fa480169a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.703899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cdfb6-e476-4543-b050-7fa480169a1b None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.704598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cdfb6-e476-4543-b050-7fa480169a1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:47.704884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cdfb6-e476-4543-b050-7fa480169a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.706550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cdfb6-e476-4543-b050-7fa480169a1b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.720064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 474/953] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:47.721317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e224-ab97-489b-8f3f-c659f1f2f675 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.721605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e224-ab97-489b-8f3f-c659f1f2f675 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.721870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e224-ab97-489b-8f3f-c659f1f2f675 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.726838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 475/954] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:47.728002 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19e224-ab97-489b-8f3f-c659f1f2f675 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:47.773706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:47.799154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61f9f1-8463-4516-b976-5d05969c9410 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.839791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eea2b-048f-46bd-986b-f952e53dcc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.840034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19e224-ab97-489b-8f3f-c659f1f2f675 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:47.840399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eea2b-048f-46bd-986b-f952e53dcc5f None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.840678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eea2b-048f-46bd-986b-f952e53dcc5f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.840947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eea2b-048f-46bd-986b-f952e53dcc5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.841739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eea2b-048f-46bd-986b-f952e53dcc5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.843487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eea2b-048f-46bd-986b-f952e53dcc5f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.874943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 480/955] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:47.874943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c9b53-9c6b-41de-9e79-17b3ca101cc1 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.874943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c9b53-9c6b-41de-9e79-17b3ca101cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.874943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c9b53-9c6b-41de-9e79-17b3ca101cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.891137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c72c9b53-9c6b-41de-9e79-17b3ca101cc1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:47.892487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c72c9b53-9c6b-41de-9e79-17b3ca101cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:47.899469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:47.902341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e516-9d8c-4dca-92ec-b17dc3a3d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:47.903191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e516-9d8c-4dca-92ec-b17dc3a3d49c None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:47.903524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e516-9d8c-4dca-92ec-b17dc3a3d49c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:47.903797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e516-9d8c-4dca-92ec-b17dc3a3d49c None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/1e97f5a53a9248438740d138d69596dd/roles/3d0b905c684f446b892eae2d95c4a6cf` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:47.906493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e516-9d8c-4dca-92ec-b17dc3a3d49c None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=1e97f5a53a9248438740d138d69596dd, role_id=3d0b905c684f446b892eae2d95c4a6cf)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:47.908709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e516-9d8c-4dca-92ec-b17dc3a3d49c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:47.935159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 476/956] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:33:47 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/1e97f5a53a9248438740d138d69596dd/roles/3d0b905c684f446b892eae2d95c4a6cf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:33:47.987999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 481/957] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:48.276597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e516-9d8c-4dca-92ec-b17dc3a3d49c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:48.391131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:48.395059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e516-9d8c-4dca-92ec-b17dc3a3d49c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:48.435450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8639aba-e001-4c1a-a0c9-966612f33d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:48.436094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8639aba-e001-4c1a-a0c9-966612f33d03 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:48.436697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8639aba-e001-4c1a-a0c9-966612f33d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:48.437399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8639aba-e001-4c1a-a0c9-966612f33d03 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:48.437593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8639aba-e001-4c1a-a0c9-966612f33d03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:48.439032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8639aba-e001-4c1a-a0c9-966612f33d03 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:48.440300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45508d51-aa02-49c1-9079-802b51de6b6d None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:48.440587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45508d51-aa02-49c1-9079-802b51de6b6d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:48.440864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45508d51-aa02-49c1-9079-802b51de6b6d None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:48.442454 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 482/958] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:48.447645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb782a-81a0-4c2f-92ff-5989071a46f0 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:48.447928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb782a-81a0-4c2f-92ff-5989071a46f0 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:48.448204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb782a-81a0-4c2f-92ff-5989071a46f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-e8639aba-e001-4c1a-a0c9-966612f33d03 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:48.448311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:48.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:48.450236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 477/959] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:48.458185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8639aba-e001-4c1a-a0c9-966612f33d03 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:48.472120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4ecb782a-81a0-4c2f-92ff-5989071a46f0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:48.473923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4ecb782a-81a0-4c2f-92ff-5989071a46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:48.565697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 483/960] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:48.578477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8639aba-e001-4c1a-a0c9-966612f33d03 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:48.619705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fa570-6950-48a1-87c4-f323e4aeba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:48.620569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fa570-6950-48a1-87c4-f323e4aeba25 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:48.621001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fa570-6950-48a1-87c4-f323e4aeba25 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:48.621445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fa570-6950-48a1-87c4-f323e4aeba25 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:48.622243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fa570-6950-48a1-87c4-f323e4aeba25 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:48.622729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fa570-6950-48a1-87c4-f323e4aeba25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:48.625024 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fa570-6950-48a1-87c4-f323e4aeba25 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:48.630672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 478/961] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:48.637044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb782a-81a0-4c2f-92ff-5989071a46f0 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:48.713760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:48.753574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb782a-81a0-4c2f-92ff-5989071a46f0 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:48.788788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9ff0-5a57-4236-b986-18b79d501afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:48.789401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9ff0-5a57-4236-b986-18b79d501afb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:48.789680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9ff0-5a57-4236-b986-18b79d501afb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:48.789955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9ff0-5a57-4236-b986-18b79d501afb None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:48.790585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9ff0-5a57-4236-b986-18b79d501afb None admin] RBAC: Adding query filter params (type=compute) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:48.790911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9ff0-5a57-4236-b986-18b79d501afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:48.792280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9ff0-5a57-4236-b986-18b79d501afb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:48.798108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 484/962] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:48.846507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fa570-6950-48a1-87c4-f323e4aeba25 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:48.881776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:48.990102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fa570-6950-48a1-87c4-f323e4aeba25 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:49.026212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:49.026876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:49.027161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:49.027433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:49.028105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:49.029572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:49.047199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.sql.core [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 11:33:49.047199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 11:33:49.047199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [parameters: {'user_id': 'ea5f2aee1a4d4a8a93ade4c677b9f681', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 11:33:49.047199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88085) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application result.read() Aug 24 11:33:49.054702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:33:49.055621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application yield resource Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application next(self.gen) Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise self.value Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application session.commit() Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 11:33:49.056584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.session.flush() Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application compat.raise_( Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 11:33:49.057475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 11:33:49.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application conn.query(q) Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application result.read() Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 11:33:49.060836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ea5f2aee1a4d4a8a93ade4c677b9f681', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:49.063964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 11:33:49.065907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 11:33:49.067823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 11:33:49.067823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 11:33:49.067823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 11:33:49.067823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 11:33:49.067823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 11:33:49.067823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:49.067823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 479/963] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 11:33:48 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:49.068230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9ff0-5a57-4236-b986-18b79d501afb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:49.181146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9ff0-5a57-4236-b986-18b79d501afb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:49.217318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6099-07d5-425a-abe4-538f66fc187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:49.218699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6099-07d5-425a-abe4-538f66fc187e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:49.218941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6099-07d5-425a-abe4-538f66fc187e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:49.219140 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6099-07d5-425a-abe4-538f66fc187e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:49.221305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:49.227397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6099-07d5-425a-abe4-538f66fc187e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:49.228874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6099-07d5-425a-abe4-538f66fc187e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-deeb6099-07d5-425a-abe4-538f66fc187e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:49.241730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:49.243708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:49.245044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 485/964] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:33:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:49.248989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:49.352732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:49.367595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90943b1-6634-407d-82a4-916f0f2d3f19 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:49.406493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400a2fa-c255-489b-b639-011ad9909acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:49.407217 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400a2fa-c255-489b-b639-011ad9909acd None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:49.407501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400a2fa-c255-489b-b639-011ad9909acd None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:49.407777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400a2fa-c255-489b-b639-011ad9909acd None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:49.408489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400a2fa-c255-489b-b639-011ad9909acd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:49.408792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400a2fa-c255-489b-b639-011ad9909acd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:49.410435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400a2fa-c255-489b-b639-011ad9909acd None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:49.451913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 480/965] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 11:33:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:49.887828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7cd3-6a0f-4465-8c5d-8dc8a64264ff None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:49.888260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7cd3-6a0f-4465-8c5d-8dc8a64264ff None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:49.888364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7cd3-6a0f-4465-8c5d-8dc8a64264ff None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:49.889789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 486/966] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:49.895882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60c71d-5b1f-4825-adc5-bc57daae8d41 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:49.896223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60c71d-5b1f-4825-adc5-bc57daae8d41 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:49.896576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60c71d-5b1f-4825-adc5-bc57daae8d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:49.915451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6b60c71d-5b1f-4825-adc5-bc57daae8d41 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:49.916976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6b60c71d-5b1f-4825-adc5-bc57daae8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:49.997809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 481/967] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:50.050496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f40f78-4f5e-400a-934d-622d492ae8a6 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.050948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f40f78-4f5e-400a-934d-622d492ae8a6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.051077 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f40f78-4f5e-400a-934d-622d492ae8a6 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.052593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 487/968] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:50.057646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14840-2757-43ba-8c59-c78f91402f8d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.057946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14840-2757-43ba-8c59-c78f91402f8d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.058222 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14840-2757-43ba-8c59-c78f91402f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.078495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-94c14840-2757-43ba-8c59-c78f91402f8d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:50.079736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-94c14840-2757-43ba-8c59-c78f91402f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:50.149902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 482/969] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:50.266956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f40f78-4f5e-400a-934d-622d492ae8a6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.373774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f40f78-4f5e-400a-934d-622d492ae8a6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.409252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e30c51-5e0d-4092-9e5a-87c81fe262ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.409785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30c51-5e0d-4092-9e5a-87c81fe262ea None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.410068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30c51-5e0d-4092-9e5a-87c81fe262ea None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.410341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30c51-5e0d-4092-9e5a-87c81fe262ea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.410959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e30c51-5e0d-4092-9e5a-87c81fe262ea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.412319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e30c51-5e0d-4092-9e5a-87c81fe262ea None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-26e30c51-5e0d-4092-9e5a-87c81fe262ea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:50.421915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:50.422971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:50.423861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:50.425480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 488/970] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:50.428926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c14840-2757-43ba-8c59-c78f91402f8d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.431626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e30c51-5e0d-4092-9e5a-87c81fe262ea None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.440792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:50.498228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:50.544510 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e30c51-5e0d-4092-9e5a-87c81fe262ea None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.551216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c14840-2757-43ba-8c59-c78f91402f8d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.583672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c80fd-f90a-496c-aa16-28668bb013eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.584311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c80fd-f90a-496c-aa16-28668bb013eb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.584597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c80fd-f90a-496c-aa16-28668bb013eb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.584873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c80fd-f90a-496c-aa16-28668bb013eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.587416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37429-0e58-44ca-b66a-baa980aa21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.588197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37429-0e58-44ca-b66a-baa980aa21b5 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.588617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37429-0e58-44ca-b66a-baa980aa21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.589042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37429-0e58-44ca-b66a-baa980aa21b5 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.589847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37429-0e58-44ca-b66a-baa980aa21b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:50.590299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37429-0e58-44ca-b66a-baa980aa21b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.591829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37429-0e58-44ca-b66a-baa980aa21b5 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.596748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c80fd-f90a-496c-aa16-28668bb013eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:33:50.598292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 483/971] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-423c80fd-f90a-496c-aa16-28668bb013eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:33:50.601669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:50.602567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:50.606630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 489/972] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:50.607862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37429-0e58-44ca-b66a-baa980aa21b5 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.609391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c80fd-f90a-496c-aa16-28668bb013eb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.685481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:50.726602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37429-0e58-44ca-b66a-baa980aa21b5 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.728904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c80fd-f90a-496c-aa16-28668bb013eb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.749374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:50.773011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654d17-1cea-4580-a493-2b651f91ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.773727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654d17-1cea-4580-a493-2b651f91ba7b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.774012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654d17-1cea-4580-a493-2b651f91ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.774283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69c3e2-d11d-49bb-9920-2aaa8277ca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.774405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654d17-1cea-4580-a493-2b651f91ba7b None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.774944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10654d17-1cea-4580-a493-2b651f91ba7b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:50.775218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c3e2-d11d-49bb-9920-2aaa8277ca2a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.775316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10654d17-1cea-4580-a493-2b651f91ba7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.775667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c3e2-d11d-49bb-9920-2aaa8277ca2a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.776100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c3e2-d11d-49bb-9920-2aaa8277ca2a None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.776589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10654d17-1cea-4580-a493-2b651f91ba7b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.776775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69c3e2-d11d-49bb-9920-2aaa8277ca2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:50.777071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69c3e2-d11d-49bb-9920-2aaa8277ca2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.778482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69c3e2-d11d-49bb-9920-2aaa8277ca2a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.789332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 484/973] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:50.791393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654d17-1cea-4580-a493-2b651f91ba7b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.793303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 490/974] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:50.799432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69c3e2-d11d-49bb-9920-2aaa8277ca2a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.905837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654d17-1cea-4580-a493-2b651f91ba7b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.906161 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69c3e2-d11d-49bb-9920-2aaa8277ca2a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:50.941345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d82d6-4a0d-4383-8b00-631ce5599181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.942302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d82d6-4a0d-4383-8b00-631ce5599181 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.942302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d82d6-4a0d-4383-8b00-631ce5599181 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.942470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d82d6-4a0d-4383-8b00-631ce5599181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.943089 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0714e1-c3ec-4427-9271-e9648d2eff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:50.943701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0714e1-c3ec-4427-9271-e9648d2eff3b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.943976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0714e1-c3ec-4427-9271-e9648d2eff3b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.944244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0714e1-c3ec-4427-9271-e9648d2eff3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.944960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0714e1-c3ec-4427-9271-e9648d2eff3b None admin] RBAC: Adding query filter params (interface=admin, service_id=d9d946b2e6814f66adad6a55fdb97de9, region_id=RegionOne) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:50.945263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0714e1-c3ec-4427-9271-e9648d2eff3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.946652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0714e1-c3ec-4427-9271-e9648d2eff3b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.948369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:50.954319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d82d6-4a0d-4383-8b00-631ce5599181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:50.955120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 485/975] 10.222.0.59 () {56 vars in 1249 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/endpoints?service_id=d9d946b2e6814f66adad6a55fdb97de9&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:50.955786 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d82d6-4a0d-4383-8b00-631ce5599181 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:50.956317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3d36e-e3c0-45fa-b907-3b41186b62e9 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.956598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3d36e-e3c0-45fa-b907-3b41186b62e9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.956865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3d36e-e3c0-45fa-b907-3b41186b62e9 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.958214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 486/976] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:50.962936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3d36e-e3c0-45fa-b907-3b41186b62e9 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-f42d82d6-4a0d-4383-8b00-631ce5599181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:50.971805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:50.972923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:50.974359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:50.974359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:50.974359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:50.974359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 491/977] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:50.974359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb523a1-8603-4c39-b584-ec41c489fecf None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:50.974359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb523a1-8603-4c39-b584-ec41c489fecf None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:50.974725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb523a1-8603-4c39-b584-ec41c489fecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:50.992733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6eb523a1-8603-4c39-b584-ec41c489fecf None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:50.994045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6eb523a1-8603-4c39-b584-ec41c489fecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:51.021594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:51.066009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 492/978] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:51.066922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb523a1-8603-4c39-b584-ec41c489fecf None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:51.081304 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3d36e-e3c0-45fa-b907-3b41186b62e9 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:51.121479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd2ffe-6c3c-4124-9213-82dc650d41f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:51.122119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd2ffe-6c3c-4124-9213-82dc650d41f2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.122398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd2ffe-6c3c-4124-9213-82dc650d41f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.122670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd2ffe-6c3c-4124-9213-82dc650d41f2 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.123312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd2ffe-6c3c-4124-9213-82dc650d41f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:51.124941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd2ffe-6c3c-4124-9213-82dc650d41f2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:51.142806 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 487/979] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 11:33:50 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:51.187546 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb523a1-8603-4c39-b584-ec41c489fecf None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:51.228944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e74711-eef3-43eb-a7f6-0741bd185c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:51.229537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e74711-eef3-43eb-a7f6-0741bd185c64 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.229813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e74711-eef3-43eb-a7f6-0741bd185c64 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.230086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e74711-eef3-43eb-a7f6-0741bd185c64 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.230881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e74711-eef3-43eb-a7f6-0741bd185c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:51.231127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e74711-eef3-43eb-a7f6-0741bd185c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:51.232519 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e74711-eef3-43eb-a7f6-0741bd185c64 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:51.251547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 493/980] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:51.252881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd2ffe-6c3c-4124-9213-82dc650d41f2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:51.318585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:51.349920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e74711-eef3-43eb-a7f6-0741bd185c64 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:51.358693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd2ffe-6c3c-4124-9213-82dc650d41f2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:51.377473 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:51.396029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbe859-52a0-467a-80b5-4db153500562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:51.396659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbe859-52a0-467a-80b5-4db153500562 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.396937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbe859-52a0-467a-80b5-4db153500562 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.397205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbe859-52a0-467a-80b5-4db153500562 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.404945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbe859-52a0-467a-80b5-4db153500562 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:51.406790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbe859-52a0-467a-80b5-4db153500562 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-a6cbe859-52a0-467a-80b5-4db153500562 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:33:51.418656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:51.419871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:51.420885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 488/981] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:33:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:51.425506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbe859-52a0-467a-80b5-4db153500562 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:51.463964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e74711-eef3-43eb-a7f6-0741bd185c64 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:51.502670 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d28ec-f33e-4c68-ade9-8ae4da76cf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:51.503270 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d28ec-f33e-4c68-ade9-8ae4da76cf4d None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.503533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d28ec-f33e-4c68-ade9-8ae4da76cf4d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.503810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d28ec-f33e-4c68-ade9-8ae4da76cf4d None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.504476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d28ec-f33e-4c68-ade9-8ae4da76cf4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:51.505853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d28ec-f33e-4c68-ade9-8ae4da76cf4d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:51.522804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 494/982] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:33:51 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:33:51.549432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbe859-52a0-467a-80b5-4db153500562 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:51.576331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:51.600344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729dccb-64dc-43fd-a5e8-545d25c18be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:51.600977 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729dccb-64dc-43fd-a5e8-545d25c18be0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.601258 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729dccb-64dc-43fd-a5e8-545d25c18be0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.601529 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729dccb-64dc-43fd-a5e8-545d25c18be0 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.602296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729dccb-64dc-43fd-a5e8-545d25c18be0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:51.602603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729dccb-64dc-43fd-a5e8-545d25c18be0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:51.604129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729dccb-64dc-43fd-a5e8-545d25c18be0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:51.627123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 489/983] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 11:33:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:51.631078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d28ec-f33e-4c68-ade9-8ae4da76cf4d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:51.729410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:51.752472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d28ec-f33e-4c68-ade9-8ae4da76cf4d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:51.789936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b023ee-1d48-41e0-8ce7-146d3e42666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:51.790466 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b023ee-1d48-41e0-8ce7-146d3e42666e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:51.790833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b023ee-1d48-41e0-8ce7-146d3e42666e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:51.791113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b023ee-1d48-41e0-8ce7-146d3e42666e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:51.863996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b023ee-1d48-41e0-8ce7-146d3e42666e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:51.865450 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b023ee-1d48-41e0-8ce7-146d3e42666e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:51.961534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:51.982738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 495/984] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:33:51 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:33:51.988953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729dccb-64dc-43fd-a5e8-545d25c18be0 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:52.098252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729dccb-64dc-43fd-a5e8-545d25c18be0 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:52.140351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932365f-eace-4e6a-b454-ab710f21d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:52.140990 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932365f-eace-4e6a-b454-ab710f21d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:52.141276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932365f-eace-4e6a-b454-ab710f21d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:52.141540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932365f-eace-4e6a-b454-ab710f21d8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:52.152990 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932365f-eace-4e6a-b454-ab710f21d8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:52.154429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932365f-eace-4e6a-b454-ab710f21d8e1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-7932365f-eace-4e6a-b454-ab710f21d8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:33:52.170434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:52.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:33:52.173449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:33:52.173449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:33:52.173449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:52.173449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 490/985] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:52.177801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b023ee-1d48-41e0-8ce7-146d3e42666e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:52.288171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b023ee-1d48-41e0-8ce7-146d3e42666e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:52.323882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30d752-e766-4bf9-960d-fafe46ba0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:52.324486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30d752-e766-4bf9-960d-fafe46ba0c7c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:52.324763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30d752-e766-4bf9-960d-fafe46ba0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:52.325038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30d752-e766-4bf9-960d-fafe46ba0c7c None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:52.325672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30d752-e766-4bf9-960d-fafe46ba0c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:52.325971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30d752-e766-4bf9-960d-fafe46ba0c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:52.328173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30d752-e766-4bf9-960d-fafe46ba0c7c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:52.339828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 496/986] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:52.345525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932365f-eace-4e6a-b454-ab710f21d8e1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:52.375687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:52.448733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932365f-eace-4e6a-b454-ab710f21d8e1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:52.485254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc9f82-284a-4fe3-9602-4254802f5bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:52.485898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc9f82-284a-4fe3-9602-4254802f5bfc None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:52.486176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc9f82-284a-4fe3-9602-4254802f5bfc None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:52.486445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc9f82-284a-4fe3-9602-4254802f5bfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:52.493301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc9f82-284a-4fe3-9602-4254802f5bfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:52.494728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc9f82-284a-4fe3-9602-4254802f5bfc None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-eabc9f82-284a-4fe3-9602-4254802f5bfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:33:52.506925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:52.507972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:52.508891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:33:52.508891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:33:52.508891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:33:52.508891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:33:52.508891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:33:52.508891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:33:52.508891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:33:52.508891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:52.508891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 491/987] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:52.514152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30d752-e766-4bf9-960d-fafe46ba0c7c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:52.563793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:52.627382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30d752-e766-4bf9-960d-fafe46ba0c7c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:52.662845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a0f9-3683-4bd2-8610-9aaae87ebe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:52.663483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a0f9-3683-4bd2-8610-9aaae87ebe26 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:52.663766 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a0f9-3683-4bd2-8610-9aaae87ebe26 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:52.664106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a0f9-3683-4bd2-8610-9aaae87ebe26 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:52.664840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213a0f9-3683-4bd2-8610-9aaae87ebe26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:52.665153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213a0f9-3683-4bd2-8610-9aaae87ebe26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:52.666638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213a0f9-3683-4bd2-8610-9aaae87ebe26 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:52.682335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 497/988] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:52.689427 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc9f82-284a-4fe3-9602-4254802f5bfc None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:52.786840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:52.800726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc9f82-284a-4fe3-9602-4254802f5bfc None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:52.839309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017a6d-e4fe-447c-ba44-1b428bfd13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:52.839914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017a6d-e4fe-447c-ba44-1b428bfd13c4 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:52.840197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017a6d-e4fe-447c-ba44-1b428bfd13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:52.840473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017a6d-e4fe-447c-ba44-1b428bfd13c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:52.841200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b017a6d-e4fe-447c-ba44-1b428bfd13c4 None admin] RBAC: Adding query filter params (role.id=3d0b905c684f446b892eae2d95c4a6cf, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=1e97f5a53a9248438740d138d69596dd) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:52.841513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b017a6d-e4fe-447c-ba44-1b428bfd13c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:52.844070 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b017a6d-e4fe-447c-ba44-1b428bfd13c4 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:52.859064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 492/989] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:33:52 2022] GET /identity/v3/role_assignments?user.id=1e97f5a53a9248438740d138d69596dd&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=3d0b905c684f446b892eae2d95c4a6cf => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:53.105377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c02fae-e404-4720-92c8-e11c1cf92402 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.105663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c02fae-e404-4720-92c8-e11c1cf92402 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.106043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c02fae-e404-4720-92c8-e11c1cf92402 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.107477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 498/990] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:53.113389 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf412e1-b64a-4a27-aa4f-66dd4f9c8b16 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.113680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf412e1-b64a-4a27-aa4f-66dd4f9c8b16 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.113956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf412e1-b64a-4a27-aa4f-66dd4f9c8b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.133739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-edf412e1-b64a-4a27-aa4f-66dd4f9c8b16 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:53.135222 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-edf412e1-b64a-4a27-aa4f-66dd4f9c8b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:53.212069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 493/991] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:53.481386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c02fae-e404-4720-92c8-e11c1cf92402 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:53.518113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1330a-7b0e-46ce-ba6d-8ae1978e29fe None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.518504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1330a-7b0e-46ce-ba6d-8ae1978e29fe None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.518880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1330a-7b0e-46ce-ba6d-8ae1978e29fe None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.520306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 494/992] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:53.525134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02652-72f0-4d7a-bae9-12c54ea2b539 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.525412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02652-72f0-4d7a-bae9-12c54ea2b539 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.525680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02652-72f0-4d7a-bae9-12c54ea2b539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.544112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-bee02652-72f0-4d7a-bae9-12c54ea2b539 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:53.545310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bee02652-72f0-4d7a-bae9-12c54ea2b539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:53.595522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c02fae-e404-4720-92c8-e11c1cf92402 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:53.597688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:53.615829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 495/993] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:53.638096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb684202-be02-4bc2-a31a-98f63c74b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:53.638728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb684202-be02-4bc2-a31a-98f63c74b1db None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.639040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb684202-be02-4bc2-a31a-98f63c74b1db None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.639909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb684202-be02-4bc2-a31a-98f63c74b1db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.640498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb684202-be02-4bc2-a31a-98f63c74b1db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:53.641869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb684202-be02-4bc2-a31a-98f63c74b1db None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-cb684202-be02-4bc2-a31a-98f63c74b1db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:53.650918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:53.655509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:33:53.656539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 499/994] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 11:33:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:53.659059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02652-72f0-4d7a-bae9-12c54ea2b539 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:53.674174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:53.766364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02652-72f0-4d7a-bae9-12c54ea2b539 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:53.803159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c77152-10ba-45f7-9668-ded40a821a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:53.803774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77152-10ba-45f7-9668-ded40a821a2b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.804057 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77152-10ba-45f7-9668-ded40a821a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.804332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77152-10ba-45f7-9668-ded40a821a2b None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.804959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c77152-10ba-45f7-9668-ded40a821a2b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:53.805262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c77152-10ba-45f7-9668-ded40a821a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:53.806658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c77152-10ba-45f7-9668-ded40a821a2b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:53.811873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 496/995] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:53.817367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb684202-be02-4bc2-a31a-98f63c74b1db None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:53.893758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c77152-10ba-45f7-9668-ded40a821a2b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:53.923498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb684202-be02-4bc2-a31a-98f63c74b1db None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:53.961374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498175-0532-42c0-b62a-975b7e2f8a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:53.962075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498175-0532-42c0-b62a-975b7e2f8a51 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:53.962422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498175-0532-42c0-b62a-975b7e2f8a51 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:53.962775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498175-0532-42c0-b62a-975b7e2f8a51 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:53.963498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498175-0532-42c0-b62a-975b7e2f8a51 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:53.963874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498175-0532-42c0-b62a-975b7e2f8a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:53.965362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498175-0532-42c0-b62a-975b7e2f8a51 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:53.977379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 500/996] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 11:33:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:53.978878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498175-0532-42c0-b62a-975b7e2f8a51 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:53.998583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:54.014220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:54.024476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c77152-10ba-45f7-9668-ded40a821a2b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:54.063218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809c6f-3111-49f1-b0f4-802b0d832d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:54.063943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809c6f-3111-49f1-b0f4-802b0d832d8d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.064296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809c6f-3111-49f1-b0f4-802b0d832d8d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.064638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809c6f-3111-49f1-b0f4-802b0d832d8d None admin] PATH_INFO: `/v3/services/compute` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.065286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809c6f-3111-49f1-b0f4-802b0d832d8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:54.066704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809c6f-3111-49f1-b0f4-802b0d832d8d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-21809c6f-3111-49f1-b0f4-802b0d832d8d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:54.075670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:54.077129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:54.078157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 497/997] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:33:54.083783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809c6f-3111-49f1-b0f4-802b0d832d8d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:54.095880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498175-0532-42c0-b62a-975b7e2f8a51 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:54.132779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc4087-878a-4a01-8bcc-5e55f91450aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:54.133391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc4087-878a-4a01-8bcc-5e55f91450aa None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.133969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc4087-878a-4a01-8bcc-5e55f91450aa None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.133969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc4087-878a-4a01-8bcc-5e55f91450aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.134631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc4087-878a-4a01-8bcc-5e55f91450aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:54.136298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc4087-878a-4a01-8bcc-5e55f91450aa None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:54.154352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 501/998] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:33:54.205620 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809c6f-3111-49f1-b0f4-802b0d832d8d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:54.252709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb1534-b177-4184-b1d2-b65eb6103041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:54.253347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb1534-b177-4184-b1d2-b65eb6103041 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.253607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb1534-b177-4184-b1d2-b65eb6103041 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.253881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb1534-b177-4184-b1d2-b65eb6103041 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.254519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb1534-b177-4184-b1d2-b65eb6103041 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:54.254858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb1534-b177-4184-b1d2-b65eb6103041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:54.256241 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb1534-b177-4184-b1d2-b65eb6103041 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:54.258409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:54.268391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 498/999] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:54.269246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc4087-878a-4a01-8bcc-5e55f91450aa None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:54.375035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:54.387866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc4087-878a-4a01-8bcc-5e55f91450aa None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:54.425499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d28c7e-61d4-46cc-8090-b401d8c224f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:54.426116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d28c7e-61d4-46cc-8090-b401d8c224f9 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.426394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d28c7e-61d4-46cc-8090-b401d8c224f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.426665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d28c7e-61d4-46cc-8090-b401d8c224f9 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.427329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d28c7e-61d4-46cc-8090-b401d8c224f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:54.427627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d28c7e-61d4-46cc-8090-b401d8c224f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:54.428988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d28c7e-61d4-46cc-8090-b401d8c224f9 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:54.434316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 502/1000] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:54.440091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb1534-b177-4184-b1d2-b65eb6103041 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:54.547799 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb1534-b177-4184-b1d2-b65eb6103041 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:54.581625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2d675-0cf9-47c5-88be-39b5e48cb646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:54.582231 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2d675-0cf9-47c5-88be-39b5e48cb646 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.582511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2d675-0cf9-47c5-88be-39b5e48cb646 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.582820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2d675-0cf9-47c5-88be-39b5e48cb646 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.583501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2d675-0cf9-47c5-88be-39b5e48cb646 None admin] RBAC: Adding query filter params (interface=public, service_id=1a8fa95466e24b6a8ce4296341602eac, region_id=RegionOne) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:54.583807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2d675-0cf9-47c5-88be-39b5e48cb646 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:54.585150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2d675-0cf9-47c5-88be-39b5e48cb646 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:54.590501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 499/1001] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 11:33:54 2022] GET /identity/v3/endpoints?service_id=1a8fa95466e24b6a8ce4296341602eac&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:54.596403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d28c7e-61d4-46cc-8090-b401d8c224f9 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:54.700884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d28c7e-61d4-46cc-8090-b401d8c224f9 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:54.735265 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204a500-5220-40a3-822c-4c1398ae98a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:54.735872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204a500-5220-40a3-822c-4c1398ae98a8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.736151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204a500-5220-40a3-822c-4c1398ae98a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.736424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204a500-5220-40a3-822c-4c1398ae98a8 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.737019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204a500-5220-40a3-822c-4c1398ae98a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:54.738384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204a500-5220-40a3-822c-4c1398ae98a8 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:54.746367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 503/1002] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 11:33:54 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:33:54.855237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6622314-227f-48d8-aa1c-5318aabbeebd None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.855767 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6622314-227f-48d8-aa1c-5318aabbeebd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.855767 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6622314-227f-48d8-aa1c-5318aabbeebd None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.857370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 500/1003] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:54.863422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533b82f-b678-46f6-856d-81cf54191d4c None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:54.863710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533b82f-b678-46f6-856d-81cf54191d4c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:54.863995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533b82f-b678-46f6-856d-81cf54191d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:54.884278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4533b82f-b678-46f6-856d-81cf54191d4c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:54.885750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4533b82f-b678-46f6-856d-81cf54191d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:54.901076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:54.966884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 504/1004] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:55.236978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6622314-227f-48d8-aa1c-5318aabbeebd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:55.307353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:55.350372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6622314-227f-48d8-aa1c-5318aabbeebd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:55.387041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249801-7116-419d-bb2e-847b639c907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:55.387738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249801-7116-419d-bb2e-847b639c907b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:55.388022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249801-7116-419d-bb2e-847b639c907b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:55.388340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249801-7116-419d-bb2e-847b639c907b None admin] PATH_INFO: `/v3/services/image` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:55.388936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38249801-7116-419d-bb2e-847b639c907b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:55.390538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38249801-7116-419d-bb2e-847b639c907b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-38249801-7116-419d-bb2e-847b639c907b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:55.399584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:55.400599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:55.403617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 501/1005] 10.222.0.59 () {56 vars in 1105 bytes} [Wed Aug 24 11:33:55 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:55.407810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533b82f-b678-46f6-856d-81cf54191d4c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:55.519657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533b82f-b678-46f6-856d-81cf54191d4c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:55.558269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c6728-ccf2-4af8-abde-f48c51061089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:55.558917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6728-ccf2-4af8-abde-f48c51061089 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:55.559203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6728-ccf2-4af8-abde-f48c51061089 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:55.559478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6728-ccf2-4af8-abde-f48c51061089 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:55.560103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c6728-ccf2-4af8-abde-f48c51061089 None admin] RBAC: Adding query filter params (name=image) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:55.560406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c6728-ccf2-4af8-abde-f48c51061089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:55.562408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c6728-ccf2-4af8-abde-f48c51061089 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:55.572165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 505/1006] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:55.573462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249801-7116-419d-bb2e-847b639c907b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:55.688521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249801-7116-419d-bb2e-847b639c907b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:55.717142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:55.726800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4409f-bc9a-4e28-85e4-a18c6f549cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:55.727428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4409f-bc9a-4e28-85e4-a18c6f549cc8 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:55.727708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4409f-bc9a-4e28-85e4-a18c6f549cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:55.727979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4409f-bc9a-4e28-85e4-a18c6f549cc8 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:55.728609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4409f-bc9a-4e28-85e4-a18c6f549cc8 None admin] RBAC: Adding query filter params (type=image) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:55.728911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4409f-bc9a-4e28-85e4-a18c6f549cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:55.730259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4409f-bc9a-4e28-85e4-a18c6f549cc8 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:55.739223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 502/1007] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:56.140410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b54e-f887-4a35-9430-846099336d04 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:56.140928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b54e-f887-4a35-9430-846099336d04 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:56.140928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b54e-f887-4a35-9430-846099336d04 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:56.142486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 506/1008] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:56.148365 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469bbb2-3cd8-47f1-a465-f3ccefdaa7ce None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:56.148809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469bbb2-3cd8-47f1-a465-f3ccefdaa7ce None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:56.148908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469bbb2-3cd8-47f1-a465-f3ccefdaa7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:56.168102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5469bbb2-3cd8-47f1-a465-f3ccefdaa7ce None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:56.169311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5469bbb2-3cd8-47f1-a465-f3ccefdaa7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:56.250891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 503/1009] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:56.539677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605b54e-f887-4a35-9430-846099336d04 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:56.555505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:56.649534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605b54e-f887-4a35-9430-846099336d04 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:56.672543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f0b2-c52a-4232-9e4d-c30cb5fc1ec7 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:56.672827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f0b2-c52a-4232-9e4d-c30cb5fc1ec7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:56.673108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f0b2-c52a-4232-9e4d-c30cb5fc1ec7 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:56.674569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 504/1010] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:56.679436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1686-5272-4094-bd81-c85d6e7c4a1f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:56.679721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1686-5272-4094-bd81-c85d6e7c4a1f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:56.679989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1686-5272-4094-bd81-c85d6e7c4a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:56.687698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbb4c-9c21-4c9b-b0f6-62e53572a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:56.688342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbb4c-9c21-4c9b-b0f6-62e53572a75b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:56.688624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbb4c-9c21-4c9b-b0f6-62e53572a75b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:56.688895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbb4c-9c21-4c9b-b0f6-62e53572a75b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:56.690028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbb4c-9c21-4c9b-b0f6-62e53572a75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:56.691574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbb4c-9c21-4c9b-b0f6-62e53572a75b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:56.694815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 507/1011] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:56.698754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbb4c-9c21-4c9b-b0f6-62e53572a75b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:56.702550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d88f1686-5272-4094-bd81-c85d6e7c4a1f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:56.703840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d88f1686-5272-4094-bd81-c85d6e7c4a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:56.773121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 505/1012] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:33:56.791178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:56.812237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbb4c-9c21-4c9b-b0f6-62e53572a75b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:56.851121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701554d3-56bb-41e3-98ba-d733fb4c6963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:56.851729 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701554d3-56bb-41e3-98ba-d733fb4c6963 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:56.852071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701554d3-56bb-41e3-98ba-d733fb4c6963 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:56.852386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701554d3-56bb-41e3-98ba-d733fb4c6963 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:56.853041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701554d3-56bb-41e3-98ba-d733fb4c6963 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:56.854463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701554d3-56bb-41e3-98ba-d733fb4c6963 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:56.890825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 508/1013] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:33:56 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:33:57.043472 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1686-5272-4094-bd81-c85d6e7c4a1f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:57.099586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:57.151165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1686-5272-4094-bd81-c85d6e7c4a1f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:57.188287 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c042d-2851-49f3-8090-2f46a96e8546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:57.188927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c042d-2851-49f3-8090-2f46a96e8546 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:57.189207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c042d-2851-49f3-8090-2f46a96e8546 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:57.189476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c042d-2851-49f3-8090-2f46a96e8546 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:57.190072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c042d-2851-49f3-8090-2f46a96e8546 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:57.191462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c042d-2851-49f3-8090-2f46a96e8546 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-338c042d-2851-49f3-8090-2f46a96e8546 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:33:57.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:33:57.202809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:33:57.203766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 506/1014] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:33:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:33:57.208436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701554d3-56bb-41e3-98ba-d733fb4c6963 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:57.319677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701554d3-56bb-41e3-98ba-d733fb4c6963 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:57.352357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:57.360159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834238-87c0-4d03-9e2f-d9b7ac3ec2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:57.361218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834238-87c0-4d03-9e2f-d9b7ac3ec2fb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:57.361685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834238-87c0-4d03-9e2f-d9b7ac3ec2fb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:57.362143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834238-87c0-4d03-9e2f-d9b7ac3ec2fb None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:57.362984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87834238-87c0-4d03-9e2f-d9b7ac3ec2fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:57.363522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87834238-87c0-4d03-9e2f-d9b7ac3ec2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:57.365147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87834238-87c0-4d03-9e2f-d9b7ac3ec2fb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:57.370456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 509/1015] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:57.376466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c042d-2851-49f3-8090-2f46a96e8546 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:57.483576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c042d-2851-49f3-8090-2f46a96e8546 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:57.501595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:57.522460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749c57b-83c1-4dc5-a001-4281c97e9862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:57.523106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c57b-83c1-4dc5-a001-4281c97e9862 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:57.523381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c57b-83c1-4dc5-a001-4281c97e9862 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:57.523649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c57b-83c1-4dc5-a001-4281c97e9862 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:57.524277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749c57b-83c1-4dc5-a001-4281c97e9862 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:33:57.524576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749c57b-83c1-4dc5-a001-4281c97e9862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:57.525931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749c57b-83c1-4dc5-a001-4281c97e9862 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:57.532091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 507/1016] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 11:33:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:33:57.537594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834238-87c0-4d03-9e2f-d9b7ac3ec2fb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:57.647897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834238-87c0-4d03-9e2f-d9b7ac3ec2fb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:57.672298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29e0a6-d3ff-431b-8264-2025509bd626 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:57.672639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29e0a6-d3ff-431b-8264-2025509bd626 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:57.672857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29e0a6-d3ff-431b-8264-2025509bd626 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:57.674339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 508/1017] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:33:57.679283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23f98-2c37-422d-8602-0f8bb8ea37b8 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:57.679569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23f98-2c37-422d-8602-0f8bb8ea37b8 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:57.680006 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23f98-2c37-422d-8602-0f8bb8ea37b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:57.683023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776d589-3ad5-445b-ba6b-25c84e8605a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:57.683631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776d589-3ad5-445b-ba6b-25c84e8605a3 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:57.683907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776d589-3ad5-445b-ba6b-25c84e8605a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:57.684174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776d589-3ad5-445b-ba6b-25c84e8605a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:57.684833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776d589-3ad5-445b-ba6b-25c84e8605a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:57.686222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776d589-3ad5-445b-ba6b-25c84e8605a3 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:57.699368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-99d23f98-2c37-422d-8602-0f8bb8ea37b8 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:57.700809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-99d23f98-2c37-422d-8602-0f8bb8ea37b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:57.706761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 510/1018] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:33:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:57.794807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 509/1019] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:57 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:58.080772 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776d589-3ad5-445b-ba6b-25c84e8605a3 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:58.138239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:58.195991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776d589-3ad5-445b-ba6b-25c84e8605a3 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:58.243292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408ba6b-bb48-4410-acd2-05b15886874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:58.243964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408ba6b-bb48-4410-acd2-05b15886874e None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.244196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408ba6b-bb48-4410-acd2-05b15886874e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.244448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408ba6b-bb48-4410-acd2-05b15886874e None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.245111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408ba6b-bb48-4410-acd2-05b15886874e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:58.246896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408ba6b-bb48-4410-acd2-05b15886874e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:58.267508 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 511/1020] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:33:58 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:58.935132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0d1ce-96b7-4263-b1a5-4dd839ebd45f None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.935654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0d1ce-96b7-4263-b1a5-4dd839ebd45f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.935654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0d1ce-96b7-4263-b1a5-4dd839ebd45f None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.940208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 510/1021] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:58.944371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2900d8c-1616-4354-82bc-ece7a6563198 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:58.944657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2900d8c-1616-4354-82bc-ece7a6563198 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:58.944930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2900d8c-1616-4354-82bc-ece7a6563198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:58.963921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-e2900d8c-1616-4354-82bc-ece7a6563198 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:58.965093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e2900d8c-1616-4354-82bc-ece7a6563198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:59.041997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 512/1022] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:59.310242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0d1ce-96b7-4263-b1a5-4dd839ebd45f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:59.426378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0d1ce-96b7-4263-b1a5-4dd839ebd45f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:59.434111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:59.463783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f51c3-37e0-4c0b-b735-86a0e5b539fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:59.464423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f51c3-37e0-4c0b-b735-86a0e5b539fb None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.464711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f51c3-37e0-4c0b-b735-86a0e5b539fb None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.464986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f51c3-37e0-4c0b-b735-86a0e5b539fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.466143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f51c3-37e0-4c0b-b735-86a0e5b539fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:59.468179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f51c3-37e0-4c0b-b735-86a0e5b539fb None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:59.469973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 511/1023] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:33:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:33:59.475702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2900d8c-1616-4354-82bc-ece7a6563198 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:33:59.519058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:59.597584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2900d8c-1616-4354-82bc-ece7a6563198 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:33:59.633551 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188042da-5e5d-4697-9b5a-e425a4e2710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:33:59.634163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188042da-5e5d-4697-9b5a-e425a4e2710c None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.634445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188042da-5e5d-4697-9b5a-e425a4e2710c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.634721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188042da-5e5d-4697-9b5a-e425a4e2710c None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.635665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188042da-5e5d-4697-9b5a-e425a4e2710c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:33:59.637160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188042da-5e5d-4697-9b5a-e425a4e2710c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:33:59.661839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 513/1024] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:33:59 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:33:59.863223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b20df9-d5c9-45e2-b260-ad7baddac9f8 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.863597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b20df9-d5c9-45e2-b260-ad7baddac9f8 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.863826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b20df9-d5c9-45e2-b260-ad7baddac9f8 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.866571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 512/1025] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:33:59.873380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103418-8580-4936-a97b-e60af9a91f6b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:33:59.873944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103418-8580-4936-a97b-e60af9a91f6b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:33:59.874566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103418-8580-4936-a97b-e60af9a91f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:33:59.900979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-32103418-8580-4936-a97b-e60af9a91f6b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:33:59.902112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-32103418-8580-4936-a97b-e60af9a91f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:33:59.987640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 514/1026] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:33:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:00.277885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103418-8580-4936-a97b-e60af9a91f6b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.278059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a15701-792d-41a7-8a34-d59a934bf34d None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.278467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a15701-792d-41a7-8a34-d59a934bf34d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.278588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a15701-792d-41a7-8a34-d59a934bf34d None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.280829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 513/1027] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:00.286477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f41e1-963f-40ea-a9be-d88e98e2418d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.286762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f41e1-963f-40ea-a9be-d88e98e2418d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.287066 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f41e1-963f-40ea-a9be-d88e98e2418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.307307 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-da8f41e1-963f-40ea-a9be-d88e98e2418d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:00.308816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-da8f41e1-963f-40ea-a9be-d88e98e2418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:00.308934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:00.383948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 514/1028] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:34:00.398666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103418-8580-4936-a97b-e60af9a91f6b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.436969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768a7a2-a28d-455e-8cc6-5f95549ef384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.437606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768a7a2-a28d-455e-8cc6-5f95549ef384 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.437884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768a7a2-a28d-455e-8cc6-5f95549ef384 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.438156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768a7a2-a28d-455e-8cc6-5f95549ef384 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.449278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768a7a2-a28d-455e-8cc6-5f95549ef384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-a768a7a2-a28d-455e-8cc6-5f95549ef384 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:00.454982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:00.455931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:34:00.456830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:00.459096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 515/1029] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:00.462221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f41e1-963f-40ea-a9be-d88e98e2418d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.574607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f41e1-963f-40ea-a9be-d88e98e2418d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.577106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:00.612319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e3083-a81c-41e3-a7ef-9e85c474bdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.612936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e3083-a81c-41e3-a7ef-9e85c474bdb2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.613213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e3083-a81c-41e3-a7ef-9e85c474bdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.613492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e3083-a81c-41e3-a7ef-9e85c474bdb2 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.614182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e3083-a81c-41e3-a7ef-9e85c474bdb2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:00.614484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e3083-a81c-41e3-a7ef-9e85c474bdb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.615882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e3083-a81c-41e3-a7ef-9e85c474bdb2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.629128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 515/1030] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:00.630370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768a7a2-a28d-455e-8cc6-5f95549ef384 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.657982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e3083-a81c-41e3-a7ef-9e85c474bdb2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.730511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:00.753427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768a7a2-a28d-455e-8cc6-5f95549ef384 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.778851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e3083-a81c-41e3-a7ef-9e85c474bdb2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.792635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28ad82-1bcd-457e-a5c2-6e3b54db2433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.793283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28ad82-1bcd-457e-a5c2-6e3b54db2433 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.793568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28ad82-1bcd-457e-a5c2-6e3b54db2433 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.793846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28ad82-1bcd-457e-a5c2-6e3b54db2433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.805420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28ad82-1bcd-457e-a5c2-6e3b54db2433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.806914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28ad82-1bcd-457e-a5c2-6e3b54db2433 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.824047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac97a40-c9c3-45fc-a832-4c2f0f6aca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:00.824762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac97a40-c9c3-45fc-a832-4c2f0f6aca61 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:00.824978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac97a40-c9c3-45fc-a832-4c2f0f6aca61 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:00.825255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac97a40-c9c3-45fc-a832-4c2f0f6aca61 None admin] PATH_INFO: `/v3/services/image` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-be28ad82-1bcd-457e-a5c2-6e3b54db2433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:34:00.825661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:00.827230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:34:00.828374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:34:00.828374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:00.828374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:00.828584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac97a40-c9c3-45fc-a832-4c2f0f6aca61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:00.828584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac97a40-c9c3-45fc-a832-4c2f0f6aca61 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:00.830016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 516/1031] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:00.835882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28ad82-1bcd-457e-a5c2-6e3b54db2433 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-2ac97a40-c9c3-45fc-a832-4c2f0f6aca61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:00.837979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:00.839260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:00.840146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 516/1032] 10.222.0.59 () {56 vars in 1105 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:00.847614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac97a40-c9c3-45fc-a832-4c2f0f6aca61 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:00.885210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:00.965361 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28ad82-1bcd-457e-a5c2-6e3b54db2433 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:00.970065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac97a40-c9c3-45fc-a832-4c2f0f6aca61 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.007153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccd2ea-9725-4d5c-a8e2-c005a3dfce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.007769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccd2ea-9725-4d5c-a8e2-c005a3dfce2a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.008052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccd2ea-9725-4d5c-a8e2-c005a3dfce2a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.008317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccd2ea-9725-4d5c-a8e2-c005a3dfce2a None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.008960 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccd2ea-9725-4d5c-a8e2-c005a3dfce2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:01.009260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccd2ea-9725-4d5c-a8e2-c005a3dfce2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.010704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08706484-f584-4890-b15c-5d340aabf317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.010949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccd2ea-9725-4d5c-a8e2-c005a3dfce2a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.011374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08706484-f584-4890-b15c-5d340aabf317 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.011656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08706484-f584-4890-b15c-5d340aabf317 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.012041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08706484-f584-4890-b15c-5d340aabf317 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.012583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08706484-f584-4890-b15c-5d340aabf317 None admin] RBAC: Adding query filter params (name=image) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:01.012896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08706484-f584-4890-b15c-5d340aabf317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.013687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.015050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08706484-f584-4890-b15c-5d340aabf317 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.026403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 517/1033] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:01.031529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 517/1034] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:01.032107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08706484-f584-4890-b15c-5d340aabf317 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.032355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccd2ea-9725-4d5c-a8e2-c005a3dfce2a None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.152431 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccd2ea-9725-4d5c-a8e2-c005a3dfce2a None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.156622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.164865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08706484-f584-4890-b15c-5d340aabf317 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.192319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a307348-f18f-44fc-b483-537add888166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.193070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a307348-f18f-44fc-b483-537add888166 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.193412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a307348-f18f-44fc-b483-537add888166 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.193679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a307348-f18f-44fc-b483-537add888166 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.202799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a307348-f18f-44fc-b483-537add888166 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.204287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a307348-f18f-44fc-b483-537add888166 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.206295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fd084-a05a-42cd-b861-124d2dacc67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.207209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fd084-a05a-42cd-b861-124d2dacc67e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.207564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fd084-a05a-42cd-b861-124d2dacc67e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.207887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fd084-a05a-42cd-b861-124d2dacc67e None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.208597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fd084-a05a-42cd-b861-124d2dacc67e None admin] RBAC: Adding query filter params (type=image) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:01.208891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fd084-a05a-42cd-b861-124d2dacc67e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.210233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fd084-a05a-42cd-b861-124d2dacc67e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-5a307348-f18f-44fc-b483-537add888166 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:34:01.217915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:01.218917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:01.225619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 518/1035] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:01.226248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 518/1036] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:01.226336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a307348-f18f-44fc-b483-537add888166 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.226405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fd084-a05a-42cd-b861-124d2dacc67e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.285209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.333784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fd084-a05a-42cd-b861-124d2dacc67e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.336410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a307348-f18f-44fc-b483-537add888166 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.370747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0807b2-4d61-40b8-9828-79497d85dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.371379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0807b2-4d61-40b8-9828-79497d85dca4 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.371661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0807b2-4d61-40b8-9828-79497d85dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.371950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0807b2-4d61-40b8-9828-79497d85dca4 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.372679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0807b2-4d61-40b8-9828-79497d85dca4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:01.373058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0807b2-4d61-40b8-9828-79497d85dca4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.374447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0807b2-4d61-40b8-9828-79497d85dca4 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.375339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd8ab2-5453-45ac-987b-b4aff5726353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.375946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd8ab2-5453-45ac-987b-b4aff5726353 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.376231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd8ab2-5453-45ac-987b-b4aff5726353 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.376497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd8ab2-5453-45ac-987b-b4aff5726353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.377191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd8ab2-5453-45ac-987b-b4aff5726353 None admin] RBAC: Adding query filter params (interface=public, service_id=8cc1d65c28e04f18867798328953c1bc, region_id=RegionOne) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:01.377498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd8ab2-5453-45ac-987b-b4aff5726353 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.378875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd8ab2-5453-45ac-987b-b4aff5726353 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.389439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 519/1037] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/endpoints?service_id=8cc1d65c28e04f18867798328953c1bc&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:01.400136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 519/1038] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:01.400348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd8ab2-5453-45ac-987b-b4aff5726353 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.406760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0807b2-4d61-40b8-9828-79497d85dca4 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.426575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.514128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0807b2-4d61-40b8-9828-79497d85dca4 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.517105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd8ab2-5453-45ac-987b-b4aff5726353 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.540500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.550984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb0d5f-a389-4e09-8a66-72fbdc4ab474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.551596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb0d5f-a389-4e09-8a66-72fbdc4ab474 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.551877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb0d5f-a389-4e09-8a66-72fbdc4ab474 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.552352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb0d5f-a389-4e09-8a66-72fbdc4ab474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.557352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe783c-54d5-45ac-9775-188959e0596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.557958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe783c-54d5-45ac-9775-188959e0596a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.558237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe783c-54d5-45ac-9775-188959e0596a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.558507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe783c-54d5-45ac-9775-188959e0596a None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.559135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe783c-54d5-45ac-9775-188959e0596a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.560546 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe783c-54d5-45ac-9775-188959e0596a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.570999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 520/1039] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:34:01.632639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb0d5f-a389-4e09-8a66-72fbdc4ab474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.634118 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb0d5f-a389-4e09-8a66-72fbdc4ab474 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.654526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.722539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea229b-c2ee-48cd-bf33-745e2f8f6d75 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.723084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea229b-c2ee-48cd-bf33-745e2f8f6d75 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.723084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea229b-c2ee-48cd-bf33-745e2f8f6d75 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.724667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 521/1040] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:34:01.730940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c467-e9f4-4d9d-90c5-b84a8bd87417 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.731231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c467-e9f4-4d9d-90c5-b84a8bd87417 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.731502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c467-e9f4-4d9d-90c5-b84a8bd87417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.751942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c008c467-e9f4-4d9d-90c5-b84a8bd87417 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:01.753109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c008c467-e9f4-4d9d-90c5-b84a8bd87417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:01.754406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 520/1041] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:01.760539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb0d5f-a389-4e09-8a66-72fbdc4ab474 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:01.838811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 522/1042] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:01.868600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb0d5f-a389-4e09-8a66-72fbdc4ab474 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:01.887296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:01.907311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecf43d-3291-4db6-b077-67e9e36f8458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:01.907953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf43d-3291-4db6-b077-67e9e36f8458 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:01.908234 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf43d-3291-4db6-b077-67e9e36f8458 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:01.908531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf43d-3291-4db6-b077-67e9e36f8458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:01.919231 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecf43d-3291-4db6-b077-67e9e36f8458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:01.921593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecf43d-3291-4db6-b077-67e9e36f8458 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-caecf43d-3291-4db6-b077-67e9e36f8458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:34:01.938941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:01.939957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:34:01.940840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:34:01.940840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:01.940840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:01.942810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 521/1043] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:01.948634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008c467-e9f4-4d9d-90c5-b84a8bd87417 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.055676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008c467-e9f4-4d9d-90c5-b84a8bd87417 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.070082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:02.093185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7da07-065d-4ab3-be80-e88c196f772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.093963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7da07-065d-4ab3-be80-e88c196f772c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.094272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7da07-065d-4ab3-be80-e88c196f772c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.094553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7da07-065d-4ab3-be80-e88c196f772c None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.095316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7da07-065d-4ab3-be80-e88c196f772c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:02.095689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7da07-065d-4ab3-be80-e88c196f772c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.097190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7da07-065d-4ab3-be80-e88c196f772c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.110293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 523/1044] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:02.110485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecf43d-3291-4db6-b077-67e9e36f8458 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.115797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7da07-065d-4ab3-be80-e88c196f772c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.229236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecf43d-3291-4db6-b077-67e9e36f8458 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.232030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7da07-065d-4ab3-be80-e88c196f772c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.279117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799d46a-ea7a-4fad-8362-47383b381e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.280337 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f549-c252-4b66-b150-d92462b4ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.280559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799d46a-ea7a-4fad-8362-47383b381e47 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.280860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799d46a-ea7a-4fad-8362-47383b381e47 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.281137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799d46a-ea7a-4fad-8362-47383b381e47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.281298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f549-c252-4b66-b150-d92462b4ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.281666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f549-c252-4b66-b150-d92462b4ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.282014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f549-c252-4b66-b150-d92462b4ddc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.289454 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f549-c252-4b66-b150-d92462b4ddc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.290953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f549-c252-4b66-b150-d92462b4ddc4 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.295468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799d46a-ea7a-4fad-8362-47383b381e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-5799d46a-ea7a-4fad-8362-47383b381e47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:02.302114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:02.308266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:02.309176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 522/1045] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:34:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-47f2f549-c252-4b66-b150-d92462b4ddc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:34:02.309912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:02.310965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:02.313322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:34:02.313322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:34:02.313322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:34:02.313322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:34:02.313322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:34:02.313322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:34:02.313322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:34:02.313322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:02.313322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 524/1046] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:02.314454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799d46a-ea7a-4fad-8362-47383b381e47 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.314598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f549-c252-4b66-b150-d92462b4ddc4 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.345081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:02.349807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:02.420728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f549-c252-4b66-b150-d92462b4ddc4 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.428912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799d46a-ea7a-4fad-8362-47383b381e47 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.462391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ce8b8-71bd-418b-98f4-16175ed4822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.463048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ce8b8-71bd-418b-98f4-16175ed4822b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.463329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ce8b8-71bd-418b-98f4-16175ed4822b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.463602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ce8b8-71bd-418b-98f4-16175ed4822b None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.464301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ce8b8-71bd-418b-98f4-16175ed4822b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:02.464605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ce8b8-71bd-418b-98f4-16175ed4822b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.466076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ce8b8-71bd-418b-98f4-16175ed4822b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.469434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c028-5f5d-4b66-8648-8db862df1c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.470324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c028-5f5d-4b66-8648-8db862df1c96 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.470816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c028-5f5d-4b66-8648-8db862df1c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.471268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c028-5f5d-4b66-8648-8db862df1c96 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.472142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c028-5f5d-4b66-8648-8db862df1c96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:02.472631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c028-5f5d-4b66-8648-8db862df1c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.474173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c028-5f5d-4b66-8648-8db862df1c96 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.479806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 525/1047] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:02.486562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ce8b8-71bd-418b-98f4-16175ed4822b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.494948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 523/1048] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:02.496740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c028-5f5d-4b66-8648-8db862df1c96 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.596273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:02.606076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:02.617775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c028-5f5d-4b66-8648-8db862df1c96 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.618862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ce8b8-71bd-418b-98f4-16175ed4822b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.658899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b548f-3fd2-4518-8d63-d5bb3ca11030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.659823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b548f-3fd2-4518-8d63-d5bb3ca11030 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.660104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b548f-3fd2-4518-8d63-d5bb3ca11030 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.660371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b548f-3fd2-4518-8d63-d5bb3ca11030 None admin] PATH_INFO: `/v3/users/3101d9eee76f49d68d3c0e0b41eacae1` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.663353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe8914-5608-4e4c-b735-aaa8785caf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.663967 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe8914-5608-4e4c-b735-aaa8785caf82 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.664249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe8914-5608-4e4c-b735-aaa8785caf82 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.664523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe8914-5608-4e4c-b735-aaa8785caf82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.665247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe8914-5608-4e4c-b735-aaa8785caf82 None admin] RBAC: Adding query filter params (role.id=3d0b905c684f446b892eae2d95c4a6cf, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=46e2fac1066d4ad7b670d46f158fec97) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:02.665557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe8914-5608-4e4c-b735-aaa8785caf82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.667000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe8914-5608-4e4c-b735-aaa8785caf82 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.682951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 526/1049] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:02 2022] GET /identity/v3/role_assignments?user.id=46e2fac1066d4ad7b670d46f158fec97&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=3d0b905c684f446b892eae2d95c4a6cf => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:02.683804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b548f-3fd2-4518-8d63-d5bb3ca11030 None admin] RBAC: Authorizing `identity:get_user(user_id=3101d9eee76f49d68d3c0e0b41eacae1)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.685302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b548f-3fd2-4518-8d63-d5bb3ca11030 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:02.687388 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 524/1050] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:02 2022] GET /identity/v3/users/3101d9eee76f49d68d3c0e0b41eacae1 => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:02.693356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe8914-5608-4e4c-b735-aaa8785caf82 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:02.809499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe8914-5608-4e4c-b735-aaa8785caf82 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:02.851222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45c60-0b28-4900-b3e4-3d7ab98a9632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:02.851562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45c60-0b28-4900-b3e4-3d7ab98a9632 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:02.851871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45c60-0b28-4900-b3e4-3d7ab98a9632 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:02.852098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45c60-0b28-4900-b3e4-3d7ab98a9632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:02.884744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:02.934944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45c60-0b28-4900-b3e4-3d7ab98a9632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:02.936499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45c60-0b28-4900-b3e4-3d7ab98a9632 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:03.049932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 527/1051] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:03.051389 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b548f-3fd2-4518-8d63-d5bb3ca11030 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:03.159886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b548f-3fd2-4518-8d63-d5bb3ca11030 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:03.195423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75740b-2c23-45d5-9f27-1277561a603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:03.196065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75740b-2c23-45d5-9f27-1277561a603a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:03.196351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75740b-2c23-45d5-9f27-1277561a603a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:03.196627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75740b-2c23-45d5-9f27-1277561a603a None admin] PATH_INFO: `/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:03.197779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75740b-2c23-45d5-9f27-1277561a603a None admin] RBAC: Authorizing `identity:get_project(project_id=ea1b1b1d33b041fdaeabfc59f8ef2e3d)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:03.199347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75740b-2c23-45d5-9f27-1277561a603a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:03.206434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 525/1052] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:03 2022] GET /identity/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:03.207754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45c60-0b28-4900-b3e4-3d7ab98a9632 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:03.271628 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:03.318020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45c60-0b28-4900-b3e4-3d7ab98a9632 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:03.354356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d55335-a84b-4d31-818d-613949323c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:03.354989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d55335-a84b-4d31-818d-613949323c42 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:03.355262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d55335-a84b-4d31-818d-613949323c42 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:03.355533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d55335-a84b-4d31-818d-613949323c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:03.356245 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d55335-a84b-4d31-818d-613949323c42 None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=ea1b1b1d33b041fdaeabfc59f8ef2e3d, user.id=3101d9eee76f49d68d3c0e0b41eacae1) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:03.356549 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d55335-a84b-4d31-818d-613949323c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:03.357991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d55335-a84b-4d31-818d-613949323c42 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:03.370893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 528/1053] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:03 2022] GET /identity/v3/role_assignments?user.id=3101d9eee76f49d68d3c0e0b41eacae1&scope.project.id=ea1b1b1d33b041fdaeabfc59f8ef2e3d&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:03.604752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fd84c-c5a8-4d7e-97d3-9658b50f9ff4 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:03.605240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fd84c-c5a8-4d7e-97d3-9658b50f9ff4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:03.605240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fd84c-c5a8-4d7e-97d3-9658b50f9ff4 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:03.606819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 526/1054] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:03.612276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d855-92b4-43a6-b81f-e302734961cc None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:03.612566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d855-92b4-43a6-b81f-e302734961cc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:03.612845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d855-92b4-43a6-b81f-e302734961cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:03.632314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-73c0d855-92b4-43a6-b81f-e302734961cc None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:03.633556 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-73c0d855-92b4-43a6-b81f-e302734961cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:03.707602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 529/1055] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:03.993496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fd84c-c5a8-4d7e-97d3-9658b50f9ff4 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:04.014345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:04.104908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fd84c-c5a8-4d7e-97d3-9658b50f9ff4 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:04.141243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595163c9-d7d9-49a4-bcc8-39240b7368c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:04.141878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595163c9-d7d9-49a4-bcc8-39240b7368c2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:04.142159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595163c9-d7d9-49a4-bcc8-39240b7368c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:04.142494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595163c9-d7d9-49a4-bcc8-39240b7368c2 None admin] PATH_INFO: `/v3/services/image` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:04.143106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595163c9-d7d9-49a4-bcc8-39240b7368c2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:04.144467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595163c9-d7d9-49a4-bcc8-39240b7368c2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-595163c9-d7d9-49a4-bcc8-39240b7368c2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:04.153259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:04.154293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:04.155238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 527/1056] 10.222.0.59 () {56 vars in 1105 bytes} [Wed Aug 24 11:34:03 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:04.161778 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d855-92b4-43a6-b81f-e302734961cc None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:04.218903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:04.273291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d855-92b4-43a6-b81f-e302734961cc None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:04.310381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f473635-a6e5-48d0-8ae9-e605b49e6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:04.311575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f473635-a6e5-48d0-8ae9-e605b49e6517 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:04.311879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f473635-a6e5-48d0-8ae9-e605b49e6517 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:04.312125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f473635-a6e5-48d0-8ae9-e605b49e6517 None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:04.312799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f473635-a6e5-48d0-8ae9-e605b49e6517 None admin] RBAC: Adding query filter params (name=image) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:04.313105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f473635-a6e5-48d0-8ae9-e605b49e6517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:04.314548 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f473635-a6e5-48d0-8ae9-e605b49e6517 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:04.320102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 530/1057] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:04.325889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595163c9-d7d9-49a4-bcc8-39240b7368c2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:04.411492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:04.432887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595163c9-d7d9-49a4-bcc8-39240b7368c2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:04.474210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee032244-e32b-46b0-8cb1-ad2d9e63e24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:04.474733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032244-e32b-46b0-8cb1-ad2d9e63e24e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:04.475044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032244-e32b-46b0-8cb1-ad2d9e63e24e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:04.475322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032244-e32b-46b0-8cb1-ad2d9e63e24e None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:04.475961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee032244-e32b-46b0-8cb1-ad2d9e63e24e None admin] RBAC: Adding query filter params (type=image) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:04.476393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee032244-e32b-46b0-8cb1-ad2d9e63e24e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:04.477630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee032244-e32b-46b0-8cb1-ad2d9e63e24e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:04.487837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 528/1058] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:04.489358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f473635-a6e5-48d0-8ae9-e605b49e6517 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:04.594091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f473635-a6e5-48d0-8ae9-e605b49e6517 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:04.610991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:04.619844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ceb1b-127f-4a3e-9185-0e88e598da01 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:04.620333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ceb1b-127f-4a3e-9185-0e88e598da01 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:04.620444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ceb1b-127f-4a3e-9185-0e88e598da01 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:04.621755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 529/1059] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:34:04.626939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571cd3-fa75-4e87-89a8-2dab759b1a2e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:04.627232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571cd3-fa75-4e87-89a8-2dab759b1a2e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:04.627509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571cd3-fa75-4e87-89a8-2dab759b1a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:04.632246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f94e97-2b2b-4e35-8198-2dee9a2a1240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:04.633098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f94e97-2b2b-4e35-8198-2dee9a2a1240 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:04.633582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f94e97-2b2b-4e35-8198-2dee9a2a1240 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:04.634048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f94e97-2b2b-4e35-8198-2dee9a2a1240 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:04.635194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f94e97-2b2b-4e35-8198-2dee9a2a1240 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:04.636572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f94e97-2b2b-4e35-8198-2dee9a2a1240 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:04.646581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3e571cd3-fa75-4e87-89a8-2dab759b1a2e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:04.648196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3e571cd3-fa75-4e87-89a8-2dab759b1a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:04.662957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 531/1060] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:34:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:04.733797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 530/1061] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:34:05.007059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f94e97-2b2b-4e35-8198-2dee9a2a1240 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:05.117661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f94e97-2b2b-4e35-8198-2dee9a2a1240 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:05.164075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2892a9-89dd-477d-b471-720c9ff7e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:05.164845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2892a9-89dd-477d-b471-720c9ff7e2e1 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:05.164984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2892a9-89dd-477d-b471-720c9ff7e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:05.165267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2892a9-89dd-477d-b471-720c9ff7e2e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:05.178097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2892a9-89dd-477d-b471-720c9ff7e2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-6a2892a9-89dd-477d-b471-720c9ff7e2e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:05.182825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:05.184424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:34:05.186390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:05.189961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 532/1062] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 11:34:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:05.190881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571cd3-fa75-4e87-89a8-2dab759b1a2e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:05.267920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:05.302102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571cd3-fa75-4e87-89a8-2dab759b1a2e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:05.329736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8361f05-8842-4b7c-9dd2-632e4d156eb6 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:05.330062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8361f05-8842-4b7c-9dd2-632e4d156eb6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:05.330275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8361f05-8842-4b7c-9dd2-632e4d156eb6 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:05.332780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 533/1063] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:34:05.336936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa29de-7c33-4f1f-a6e1-b55eb0826932 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:05.337215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa29de-7c33-4f1f-a6e1-b55eb0826932 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:05.337487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa29de-7c33-4f1f-a6e1-b55eb0826932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:05.347487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90dffa-3680-4ecd-abff-a3a95ea17063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:05.348108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90dffa-3680-4ecd-abff-a3a95ea17063 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:05.350814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90dffa-3680-4ecd-abff-a3a95ea17063 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:05.351118 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90dffa-3680-4ecd-abff-a3a95ea17063 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:05.351824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90dffa-3680-4ecd-abff-a3a95ea17063 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:05.352131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90dffa-3680-4ecd-abff-a3a95ea17063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:05.353515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90dffa-3680-4ecd-abff-a3a95ea17063 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:05.359868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-90fa29de-7c33-4f1f-a6e1-b55eb0826932 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:05.361104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-90fa29de-7c33-4f1f-a6e1-b55eb0826932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:05.363495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 531/1064] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 11:34:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:05.370406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90dffa-3680-4ecd-abff-a3a95ea17063 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:05.395331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:05.441539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 534/1065] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:34:05.488906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90dffa-3680-4ecd-abff-a3a95ea17063 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:05.524168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:05.530061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134b0cb-8bbf-430e-a44d-db9bc91d6e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:05.530738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134b0cb-8bbf-430e-a44d-db9bc91d6e9d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:05.531059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134b0cb-8bbf-430e-a44d-db9bc91d6e9d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:05.531335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134b0cb-8bbf-430e-a44d-db9bc91d6e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:05.542707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134b0cb-8bbf-430e-a44d-db9bc91d6e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:05.545549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134b0cb-8bbf-430e-a44d-db9bc91d6e9d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-8134b0cb-8bbf-430e-a44d-db9bc91d6e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:34:05.562902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:05.563902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:34:05.564803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:34:05.564803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:05.564803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:05.567072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 532/1066] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:05.569756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa29de-7c33-4f1f-a6e1-b55eb0826932 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:05.679754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa29de-7c33-4f1f-a6e1-b55eb0826932 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:05.712941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134b0cb-8bbf-430e-a44d-db9bc91d6e9d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:05.714687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9ca79-c3a5-42f1-bcf9-3022932865d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:05.715342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9ca79-c3a5-42f1-bcf9-3022932865d4 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:05.715625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9ca79-c3a5-42f1-bcf9-3022932865d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:05.715902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9ca79-c3a5-42f1-bcf9-3022932865d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:05.716552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9ca79-c3a5-42f1-bcf9-3022932865d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:05.717394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9ca79-c3a5-42f1-bcf9-3022932865d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:05.718805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9ca79-c3a5-42f1-bcf9-3022932865d4 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:05.736710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 535/1067] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:05.738392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9ca79-c3a5-42f1-bcf9-3022932865d4 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:05.772852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:05.821600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134b0cb-8bbf-430e-a44d-db9bc91d6e9d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:05.858693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd8fd-e382-4ef0-85be-7b6042ed9a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:05.859759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd8fd-e382-4ef0-85be-7b6042ed9a3c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:05.859759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd8fd-e382-4ef0-85be-7b6042ed9a3c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:05.859987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd8fd-e382-4ef0-85be-7b6042ed9a3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:05.871080 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd8fd-e382-4ef0-85be-7b6042ed9a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:05.872269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9ca79-c3a5-42f1-bcf9-3022932865d4 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-de1dd8fd-e382-4ef0-85be-7b6042ed9a3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:05.876822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:05.877798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:05.879745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 533/1068] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:34:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:05.883948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd8fd-e382-4ef0-85be-7b6042ed9a3c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:05.915414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a9295-433e-4b24-bdba-20cd4c2a7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:05.916037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a9295-433e-4b24-bdba-20cd4c2a7bed None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:05.916317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a9295-433e-4b24-bdba-20cd4c2a7bed None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:05.916586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a9295-433e-4b24-bdba-20cd4c2a7bed None admin] PATH_INFO: `/v3/users/nova` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:05.925538 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a9295-433e-4b24-bdba-20cd4c2a7bed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:05.927017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a9295-433e-4b24-bdba-20cd4c2a7bed None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:05.938406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-e72a9295-433e-4b24-bdba-20cd4c2a7bed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:34:05.944189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:05.945098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:05.951121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 536/1069] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 11:34:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:05.952529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a9295-433e-4b24-bdba-20cd4c2a7bed None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:05.996513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd8fd-e382-4ef0-85be-7b6042ed9a3c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.034641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aa859-005e-43c7-8a17-95093d6101d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.035273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aa859-005e-43c7-8a17-95093d6101d7 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.035553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aa859-005e-43c7-8a17-95093d6101d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.035829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aa859-005e-43c7-8a17-95093d6101d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.036486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5aa859-005e-43c7-8a17-95093d6101d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:06.036787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5aa859-005e-43c7-8a17-95093d6101d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.038143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5aa859-005e-43c7-8a17-95093d6101d7 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.041697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:06.048587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 534/1070] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:34:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:06.054405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aa859-005e-43c7-8a17-95093d6101d7 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.066039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a9295-433e-4b24-bdba-20cd4c2a7bed None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.104525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6292-91d1-4ea7-ae8f-b4e2c6ddc48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.105366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6292-91d1-4ea7-ae8f-b4e2c6ddc48c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.105791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6292-91d1-4ea7-ae8f-b4e2c6ddc48c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.106211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6292-91d1-4ea7-ae8f-b4e2c6ddc48c None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.107343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc6292-91d1-4ea7-ae8f-b4e2c6ddc48c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:06.107711 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc6292-91d1-4ea7-ae8f-b4e2c6ddc48c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.109133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc6292-91d1-4ea7-ae8f-b4e2c6ddc48c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.134034 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 537/1071] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 11:34:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:06.135632 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6292-91d1-4ea7-ae8f-b4e2c6ddc48c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.168637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aa859-005e-43c7-8a17-95093d6101d7 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.177646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:06.207859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54368815-ca84-4588-8da7-a978f4ebe604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.208602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54368815-ca84-4588-8da7-a978f4ebe604 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.208861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54368815-ca84-4588-8da7-a978f4ebe604 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.209130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54368815-ca84-4588-8da7-a978f4ebe604 None admin] PATH_INFO: `/v3/users/3101d9eee76f49d68d3c0e0b41eacae1` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.210297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54368815-ca84-4588-8da7-a978f4ebe604 None admin] RBAC: Authorizing `identity:get_user(user_id=3101d9eee76f49d68d3c0e0b41eacae1)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.211752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54368815-ca84-4588-8da7-a978f4ebe604 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.213341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 535/1072] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:06 2022] GET /identity/v3/users/3101d9eee76f49d68d3c0e0b41eacae1 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:06.219004 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54368815-ca84-4588-8da7-a978f4ebe604 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.251061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6292-91d1-4ea7-ae8f-b4e2c6ddc48c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.288302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523299d-3ecc-4646-8000-0760ce74f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.288947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523299d-3ecc-4646-8000-0760ce74f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.289229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523299d-3ecc-4646-8000-0760ce74f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.289514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523299d-3ecc-4646-8000-0760ce74f6a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.301120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:06.304038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523299d-3ecc-4646-8000-0760ce74f6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.306229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523299d-3ecc-4646-8000-0760ce74f6a7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-c523299d-3ecc-4646-8000-0760ce74f6a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:34:06.326318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:06.327428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:34:06.328327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:34:06.328327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:06.328327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:06.332368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54368815-ca84-4588-8da7-a978f4ebe604 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.333116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 538/1073] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:06.333864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523299d-3ecc-4646-8000-0760ce74f6a7 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.373499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345da38-8145-48c0-b8d6-de71cf37e913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.374139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345da38-8145-48c0-b8d6-de71cf37e913 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.374417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345da38-8145-48c0-b8d6-de71cf37e913 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.374692 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345da38-8145-48c0-b8d6-de71cf37e913 None admin] PATH_INFO: `/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.375858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345da38-8145-48c0-b8d6-de71cf37e913 None admin] RBAC: Authorizing `identity:get_project(project_id=ea1b1b1d33b041fdaeabfc59f8ef2e3d)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.377285 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345da38-8145-48c0-b8d6-de71cf37e913 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.378974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 536/1074] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:06 2022] GET /identity/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:06.384808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345da38-8145-48c0-b8d6-de71cf37e913 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.436161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:06.448333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523299d-3ecc-4646-8000-0760ce74f6a7 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.488728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae3c2c-8294-4543-955c-48c10f4c6c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.489334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3c2c-8294-4543-955c-48c10f4c6c03 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.489619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3c2c-8294-4543-955c-48c10f4c6c03 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.489886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3c2c-8294-4543-955c-48c10f4c6c03 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.490559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae3c2c-8294-4543-955c-48c10f4c6c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:06.490888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae3c2c-8294-4543-955c-48c10f4c6c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.492252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae3c2c-8294-4543-955c-48c10f4c6c03 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.503795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345da38-8145-48c0-b8d6-de71cf37e913 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.504602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 539/1075] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:06.510238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae3c2c-8294-4543-955c-48c10f4c6c03 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.542593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02118e01-e608-485f-b063-dca54e973fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.543289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02118e01-e608-485f-b063-dca54e973fdd None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.543583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02118e01-e608-485f-b063-dca54e973fdd None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.543852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02118e01-e608-485f-b063-dca54e973fdd None admin] PATH_INFO: `/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d/users/3101d9eee76f49d68d3c0e0b41eacae1/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.546524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02118e01-e608-485f-b063-dca54e973fdd None admin] RBAC: Authorizing `identity:create_grant(project_id=ea1b1b1d33b041fdaeabfc59f8ef2e3d, user_id=3101d9eee76f49d68d3c0e0b41eacae1, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.547991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02118e01-e608-485f-b063-dca54e973fdd None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.563468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 537/1076] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:34:06 2022] PUT /identity/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d/users/3101d9eee76f49d68d3c0e0b41eacae1/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:06.572374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:06.622831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d617b5-4fd4-4b84-bf97-d9765171aad2 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.622831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d617b5-4fd4-4b84-bf97-d9765171aad2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.622831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d617b5-4fd4-4b84-bf97-d9765171aad2 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.622831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 538/1077] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:34:06.627243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef845cd-5230-443a-90a7-29ea57c8642b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.627482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef845cd-5230-443a-90a7-29ea57c8642b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.627905 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef845cd-5230-443a-90a7-29ea57c8642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.637909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae3c2c-8294-4543-955c-48c10f4c6c03 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.648938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5ef845cd-5230-443a-90a7-29ea57c8642b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:06.651218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5ef845cd-5230-443a-90a7-29ea57c8642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:06.681660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8343d1a-33d9-4d35-ab98-c34065996303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.682510 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343d1a-33d9-4d35-ab98-c34065996303 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.682819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343d1a-33d9-4d35-ab98-c34065996303 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.683461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343d1a-33d9-4d35-ab98-c34065996303 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.691797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343d1a-33d9-4d35-ab98-c34065996303 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.693286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343d1a-33d9-4d35-ab98-c34065996303 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-f8343d1a-33d9-4d35-ab98-c34065996303 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:34:06.706249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:06.707278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:06.708595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:34:06.708595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:34:06.708595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:34:06.708595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:34:06.708595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:34:06.708595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:34:06.708595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:34:06.708595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:06.708595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 540/1078] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:06.713852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8343d1a-33d9-4d35-ab98-c34065996303 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.734669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 539/1079] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:34:06.824639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8343d1a-33d9-4d35-ab98-c34065996303 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:06.838647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:06.862958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb3a96-644f-49e2-b562-3375f3326dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:06.863655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb3a96-644f-49e2-b562-3375f3326dfe None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:06.864008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb3a96-644f-49e2-b562-3375f3326dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:06.864352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb3a96-644f-49e2-b562-3375f3326dfe None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:06.865114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb3a96-644f-49e2-b562-3375f3326dfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:06.865492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb3a96-644f-49e2-b562-3375f3326dfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:06.867019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb3a96-644f-49e2-b562-3375f3326dfe None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:06.881555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 541/1080] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:06.887550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef845cd-5230-443a-90a7-29ea57c8642b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:06.921280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:07.003095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef845cd-5230-443a-90a7-29ea57c8642b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:07.005332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb3a96-644f-49e2-b562-3375f3326dfe None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:07.039558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299836c-2b7a-4def-9268-5ae11522c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:07.040217 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299836c-2b7a-4def-9268-5ae11522c94a None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:07.040497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299836c-2b7a-4def-9268-5ae11522c94a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:07.040756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299836c-2b7a-4def-9268-5ae11522c94a None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/46e2fac1066d4ad7b670d46f158fec97/roles/3d0b905c684f446b892eae2d95c4a6cf` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:07.042988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299836c-2b7a-4def-9268-5ae11522c94a None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=46e2fac1066d4ad7b670d46f158fec97, role_id=3d0b905c684f446b892eae2d95c4a6cf)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:07.044406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299836c-2b7a-4def-9268-5ae11522c94a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:07.059162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 540/1081] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:34:06 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/46e2fac1066d4ad7b670d46f158fec97/roles/3d0b905c684f446b892eae2d95c4a6cf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:34:07.122509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb3a96-644f-49e2-b562-3375f3326dfe None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:07.161462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11fae-3ced-4631-88e6-63dbdd44bcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:07.161856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11fae-3ced-4631-88e6-63dbdd44bcec None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:07.162145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11fae-3ced-4631-88e6-63dbdd44bcec None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:07.162384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11fae-3ced-4631-88e6-63dbdd44bcec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:07.214122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:07.244153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc11fae-3ced-4631-88e6-63dbdd44bcec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:07.245598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc11fae-3ced-4631-88e6-63dbdd44bcec None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:07.349745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 542/1082] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 11:34:07.355462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299836c-2b7a-4def-9268-5ae11522c94a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:07.454405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:07.465886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299836c-2b7a-4def-9268-5ae11522c94a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:07.502728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf527c-7e4a-4953-b6a1-a47acf592091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:07.503573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf527c-7e4a-4953-b6a1-a47acf592091 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:07.503954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf527c-7e4a-4953-b6a1-a47acf592091 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:07.504330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf527c-7e4a-4953-b6a1-a47acf592091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:07.516184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf527c-7e4a-4953-b6a1-a47acf592091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:07.517648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf527c-7e4a-4953-b6a1-a47acf592091 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-bebf527c-7e4a-4953-b6a1-a47acf592091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:34:07.534831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:07.536068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:34:07.537183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:34:07.537183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:07.537183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:07.537183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 541/1083] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:07.542172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11fae-3ced-4631-88e6-63dbdd44bcec None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:07.617711 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:07.650561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11fae-3ced-4631-88e6-63dbdd44bcec None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:07.688926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626476d-2bd3-4303-a868-5733eb784af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:07.689633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626476d-2bd3-4303-a868-5733eb784af4 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:07.689975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626476d-2bd3-4303-a868-5733eb784af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:07.690310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626476d-2bd3-4303-a868-5733eb784af4 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:07.691042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626476d-2bd3-4303-a868-5733eb784af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:07.691409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626476d-2bd3-4303-a868-5733eb784af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:07.692896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626476d-2bd3-4303-a868-5733eb784af4 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:07.710876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 543/1084] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:08.479045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc372-439b-4ce8-a18e-20325502c13c None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.479608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc372-439b-4ce8-a18e-20325502c13c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.479608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc372-439b-4ce8-a18e-20325502c13c None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.480997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 542/1085] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:08.487885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51f370-ea5c-4710-8444-f018e8ade04f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.488384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51f370-ea5c-4710-8444-f018e8ade04f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.488874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51f370-ea5c-4710-8444-f018e8ade04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.508734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-3c51f370-ea5c-4710-8444-f018e8ade04f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:08.510180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3c51f370-ea5c-4710-8444-f018e8ade04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:08.579859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 544/1086] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:08.846045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcc372-439b-4ce8-a18e-20325502c13c None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:08.953521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcc372-439b-4ce8-a18e-20325502c13c None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:08.987238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d62fe7-b533-4c8f-a0ec-1161038f53a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:08.987866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d62fe7-b533-4c8f-a0ec-1161038f53a4 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:08.988154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d62fe7-b533-4c8f-a0ec-1161038f53a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:08.988417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d62fe7-b533-4c8f-a0ec-1161038f53a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:08.998939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d62fe7-b533-4c8f-a0ec-1161038f53a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-e3d62fe7-b533-4c8f-a0ec-1161038f53a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:09.003561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:09.006932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:09.008101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 543/1087] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:09.011065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51f370-ea5c-4710-8444-f018e8ade04f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.017369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88dc47-1b75-4eca-8c9c-38010ca2a720 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.017652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88dc47-1b75-4eca-8c9c-38010ca2a720 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.017929 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88dc47-1b75-4eca-8c9c-38010ca2a720 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.019292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 544/1088] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:34:09.024198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35017c52-c3e7-4549-a1b0-8dafe006f110 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.024471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35017c52-c3e7-4549-a1b0-8dafe006f110 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.024739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35017c52-c3e7-4549-a1b0-8dafe006f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.033102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.043298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-35017c52-c3e7-4549-a1b0-8dafe006f110 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:09.044506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-35017c52-c3e7-4549-a1b0-8dafe006f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:09.075144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.115018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 545/1089] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:34:09.116046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51f370-ea5c-4710-8444-f018e8ade04f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.151967 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5772e11-a2ae-429d-9213-af40d5e6bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.152573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5772e11-a2ae-429d-9213-af40d5e6bc7c None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.152853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5772e11-a2ae-429d-9213-af40d5e6bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.153126 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5772e11-a2ae-429d-9213-af40d5e6bc7c None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.153782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5772e11-a2ae-429d-9213-af40d5e6bc7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:09.154211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5772e11-a2ae-429d-9213-af40d5e6bc7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.155602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5772e11-a2ae-429d-9213-af40d5e6bc7c None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.163980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 545/1090] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:09.170660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35017c52-c3e7-4549-a1b0-8dafe006f110 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.270796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35017c52-c3e7-4549-a1b0-8dafe006f110 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.304426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ab3bb-1ea4-4230-99fd-b897910f921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.305047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ab3bb-1ea4-4230-99fd-b897910f921b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.305323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ab3bb-1ea4-4230-99fd-b897910f921b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.305590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ab3bb-1ea4-4230-99fd-b897910f921b None admin] PATH_INFO: `/v3/users/3101d9eee76f49d68d3c0e0b41eacae1` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.306697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ab3bb-1ea4-4230-99fd-b897910f921b None admin] RBAC: Authorizing `identity:get_user(user_id=3101d9eee76f49d68d3c0e0b41eacae1)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.308135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ab3bb-1ea4-4230-99fd-b897910f921b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.315190 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 546/1091] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/users/3101d9eee76f49d68d3c0e0b41eacae1 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:09.316711 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5772e11-a2ae-429d-9213-af40d5e6bc7c None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.390428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ab3bb-1ea4-4230-99fd-b897910f921b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.394229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.421906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5772e11-a2ae-429d-9213-af40d5e6bc7c None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.446859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.459609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fceba-0b8b-43a2-abb7-196d5127baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.460220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fceba-0b8b-43a2-abb7-196d5127baec None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.460493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fceba-0b8b-43a2-abb7-196d5127baec None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.460759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fceba-0b8b-43a2-abb7-196d5127baec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.493155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ab3bb-1ea4-4230-99fd-b897910f921b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.530449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5da49-e43e-4ff0-a055-7da87b1126c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.531050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5da49-e43e-4ff0-a055-7da87b1126c2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.531704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5da49-e43e-4ff0-a055-7da87b1126c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.531704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5da49-e43e-4ff0-a055-7da87b1126c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.536733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fceba-0b8b-43a2-abb7-196d5127baec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.538193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fceba-0b8b-43a2-abb7-196d5127baec None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.542616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5da49-e43e-4ff0-a055-7da87b1126c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-b2f5da49-e43e-4ff0-a055-7da87b1126c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:09.548007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:09.548966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:09.549834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 547/1092] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:09.555080 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5da49-e43e-4ff0-a055-7da87b1126c2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.619049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.648071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 546/1093] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:09.654232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fceba-0b8b-43a2-abb7-196d5127baec None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.660311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5da49-e43e-4ff0-a055-7da87b1126c2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.679659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.695928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13377a02-eb9c-40ad-9b31-9a07c0699e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.696535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377a02-eb9c-40ad-9b31-9a07c0699e16 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.696809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377a02-eb9c-40ad-9b31-9a07c0699e16 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.697079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377a02-eb9c-40ad-9b31-9a07c0699e16 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.697795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13377a02-eb9c-40ad-9b31-9a07c0699e16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:09.698039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13377a02-eb9c-40ad-9b31-9a07c0699e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.699453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13377a02-eb9c-40ad-9b31-9a07c0699e16 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.708234 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 548/1094] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:09.714012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13377a02-eb9c-40ad-9b31-9a07c0699e16 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.766294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fceba-0b8b-43a2-abb7-196d5127baec None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.800969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d27d1f-a86c-4afe-a77c-512db6e2164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.801591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d27d1f-a86c-4afe-a77c-512db6e2164f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.801869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d27d1f-a86c-4afe-a77c-512db6e2164f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.802147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d27d1f-a86c-4afe-a77c-512db6e2164f None admin] PATH_INFO: `/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.803285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d27d1f-a86c-4afe-a77c-512db6e2164f None admin] RBAC: Authorizing `identity:get_project(project_id=ea1b1b1d33b041fdaeabfc59f8ef2e3d)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.804716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d27d1f-a86c-4afe-a77c-512db6e2164f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.806798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 547/1095] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:09.813037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d27d1f-a86c-4afe-a77c-512db6e2164f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.819399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13377a02-eb9c-40ad-9b31-9a07c0699e16 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.843055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.854261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cfc25-46a4-43f0-ad97-c706434d2911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.854919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cfc25-46a4-43f0-ad97-c706434d2911 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.855199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cfc25-46a4-43f0-ad97-c706434d2911 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.855469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cfc25-46a4-43f0-ad97-c706434d2911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.867191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cfc25-46a4-43f0-ad97-c706434d2911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.868722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cfc25-46a4-43f0-ad97-c706434d2911 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-159cfc25-46a4-43f0-ad97-c706434d2911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:34:09.884188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:09.885513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:34:09.886462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:34:09.886462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:09.886462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:09.886462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 549/1096] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:09.892094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cfc25-46a4-43f0-ad97-c706434d2911 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:09.913764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:09.923770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d27d1f-a86c-4afe-a77c-512db6e2164f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:09.963250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7febe9-ae7d-4de3-b98b-5ae5d791a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:09.964116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7febe9-ae7d-4de3-b98b-5ae5d791a4ce None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:09.964397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7febe9-ae7d-4de3-b98b-5ae5d791a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:09.964669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7febe9-ae7d-4de3-b98b-5ae5d791a4ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:09.965393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7febe9-ae7d-4de3-b98b-5ae5d791a4ce None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=ea1b1b1d33b041fdaeabfc59f8ef2e3d, user.id=3101d9eee76f49d68d3c0e0b41eacae1) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:09.965699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7febe9-ae7d-4de3-b98b-5ae5d791a4ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:09.967845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7febe9-ae7d-4de3-b98b-5ae5d791a4ce None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:09.986795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 548/1097] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/role_assignments?user.id=3101d9eee76f49d68d3c0e0b41eacae1&scope.project.id=ea1b1b1d33b041fdaeabfc59f8ef2e3d&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:09.999698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cfc25-46a4-43f0-ad97-c706434d2911 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.037571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa02413-79c3-430b-baa8-8f6610e62504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.038189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa02413-79c3-430b-baa8-8f6610e62504 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.038474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa02413-79c3-430b-baa8-8f6610e62504 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.038746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa02413-79c3-430b-baa8-8f6610e62504 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.039437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa02413-79c3-430b-baa8-8f6610e62504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:10.039738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa02413-79c3-430b-baa8-8f6610e62504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.041122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa02413-79c3-430b-baa8-8f6610e62504 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.055377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 550/1098] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:10.063056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7febe9-ae7d-4de3-b98b-5ae5d791a4ce None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.174464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7febe9-ae7d-4de3-b98b-5ae5d791a4ce None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.210496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227ad7-4ec5-47be-b89c-3f87a1c3bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.211164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227ad7-4ec5-47be-b89c-3f87a1c3bbea None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.211450 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227ad7-4ec5-47be-b89c-3f87a1c3bbea None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.211727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227ad7-4ec5-47be-b89c-3f87a1c3bbea None admin] PATH_INFO: `/v3/users/nova` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.220032 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38227ad7-4ec5-47be-b89c-3f87a1c3bbea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.221484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38227ad7-4ec5-47be-b89c-3f87a1c3bbea None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-38227ad7-4ec5-47be-b89c-3f87a1c3bbea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:34:10.233333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:10.234537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:10.235641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 549/1099] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:10.240857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa02413-79c3-430b-baa8-8f6610e62504 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.278455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:10.347644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa02413-79c3-430b-baa8-8f6610e62504 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.382051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e695650-aadb-4d8f-acd5-af3252aea4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.382656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e695650-aadb-4d8f-acd5-af3252aea4d2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.382968 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e695650-aadb-4d8f-acd5-af3252aea4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.383242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e695650-aadb-4d8f-acd5-af3252aea4d2 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.383969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e695650-aadb-4d8f-acd5-af3252aea4d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:10.384277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e695650-aadb-4d8f-acd5-af3252aea4d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.385959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e695650-aadb-4d8f-acd5-af3252aea4d2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.403922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 551/1100] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:10.410454 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227ad7-4ec5-47be-b89c-3f87a1c3bbea None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.430387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:10.514851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227ad7-4ec5-47be-b89c-3f87a1c3bbea None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.550921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed4ca7-3a87-4035-b558-a72b60d44970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.551603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed4ca7-3a87-4035-b558-a72b60d44970 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.551802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed4ca7-3a87-4035-b558-a72b60d44970 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.552055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed4ca7-3a87-4035-b558-a72b60d44970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.619132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed4ca7-3a87-4035-b558-a72b60d44970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.620562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed4ca7-3a87-4035-b558-a72b60d44970 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.637500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:10.721920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 550/1101] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:10.727851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e695650-aadb-4d8f-acd5-af3252aea4d2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:10.822757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:10.831257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e695650-aadb-4d8f-acd5-af3252aea4d2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:10.864188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e8afe-b9f3-4607-b518-6cfdaeada4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:10.864812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e8afe-b9f3-4607-b518-6cfdaeada4ab None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:10.865092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e8afe-b9f3-4607-b518-6cfdaeada4ab None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:10.865363 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e8afe-b9f3-4607-b518-6cfdaeada4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:10.876270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e8afe-b9f3-4607-b518-6cfdaeada4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:10.877822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e8afe-b9f3-4607-b518-6cfdaeada4ab None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-474e8afe-b9f3-4607-b518-6cfdaeada4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:34:10.895131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:10.896130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:34:10.897011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:34:10.897011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:34:10.897011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:10.898934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 552/1102] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:10.902002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed4ca7-3a87-4035-b558-a72b60d44970 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.000751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed4ca7-3a87-4035-b558-a72b60d44970 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.017978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:11.035563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8f979-d715-4bc7-81df-db083cee9605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.036167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8f979-d715-4bc7-81df-db083cee9605 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.036440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8f979-d715-4bc7-81df-db083cee9605 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.036711 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8f979-d715-4bc7-81df-db083cee9605 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.037340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8f979-d715-4bc7-81df-db083cee9605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:11.037638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8f979-d715-4bc7-81df-db083cee9605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.039010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8f979-d715-4bc7-81df-db083cee9605 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.050308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 551/1103] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:11.056020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e8afe-b9f3-4607-b518-6cfdaeada4ab None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.161389 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e8afe-b9f3-4607-b518-6cfdaeada4ab None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.196492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42c0e6-7e61-4f4d-b5d5-41d8908ff443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.197175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c0e6-7e61-4f4d-b5d5-41d8908ff443 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.197510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c0e6-7e61-4f4d-b5d5-41d8908ff443 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.197785 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c0e6-7e61-4f4d-b5d5-41d8908ff443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.204638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42c0e6-7e61-4f4d-b5d5-41d8908ff443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.206074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42c0e6-7e61-4f4d-b5d5-41d8908ff443 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-cc42c0e6-7e61-4f4d-b5d5-41d8908ff443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:34:11.217478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:11.218464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:11.219616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:34:11.219616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:34:11.219616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:34:11.219616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:34:11.219616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:34:11.219616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:34:11.219616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:34:11.219616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:11.222922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 553/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:34:11.224709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8f979-d715-4bc7-81df-db083cee9605 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.325377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8f979-d715-4bc7-81df-db083cee9605 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.359096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613f1c4-eb0a-4542-b3bc-8b09ce2a25e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.359702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f1c4-eb0a-4542-b3bc-8b09ce2a25e9 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.359982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f1c4-eb0a-4542-b3bc-8b09ce2a25e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.360257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f1c4-eb0a-4542-b3bc-8b09ce2a25e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.360948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613f1c4-eb0a-4542-b3bc-8b09ce2a25e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:11.361256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613f1c4-eb0a-4542-b3bc-8b09ce2a25e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.362666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613f1c4-eb0a-4542-b3bc-8b09ce2a25e9 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.376145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 552/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:11.382576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42c0e6-7e61-4f4d-b5d5-41d8908ff443 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:11.392873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:11.487044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42c0e6-7e61-4f4d-b5d5-41d8908ff443 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:11.521326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac54819-e3fa-45ee-90a0-f991b5db7ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:11.521920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac54819-e3fa-45ee-90a0-f991b5db7ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:11.522200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac54819-e3fa-45ee-90a0-f991b5db7ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:11.522469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac54819-e3fa-45ee-90a0-f991b5db7ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:11.523216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac54819-e3fa-45ee-90a0-f991b5db7ae2 None admin] RBAC: Adding query filter params (role.id=3d0b905c684f446b892eae2d95c4a6cf, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=46e2fac1066d4ad7b670d46f158fec97) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:11.523523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac54819-e3fa-45ee-90a0-f991b5db7ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:11.524946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac54819-e3fa-45ee-90a0-f991b5db7ae2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:11.542798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 554/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:11 2022] GET /identity/v3/role_assignments?user.id=46e2fac1066d4ad7b670d46f158fec97&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=3d0b905c684f446b892eae2d95c4a6cf => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:12.004827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19d225-1544-4a60-98da-a5ce190278b6 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.005375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19d225-1544-4a60-98da-a5ce190278b6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.005675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19d225-1544-4a60-98da-a5ce190278b6 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.007101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 553/1107] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:34:12.013132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eece9-9542-4d27-9d58-2cbd2acaf69c None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.013857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eece9-9542-4d27-9d58-2cbd2acaf69c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.013857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eece9-9542-4d27-9d58-2cbd2acaf69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.034570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d09eece9-9542-4d27-9d58-2cbd2acaf69c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:12.035892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d09eece9-9542-4d27-9d58-2cbd2acaf69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:12.114017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:12.122207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 555/1108] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:34:12.395211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19d225-1544-4a60-98da-a5ce190278b6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.432973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:12.503197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19d225-1544-4a60-98da-a5ce190278b6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:12.538645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd3999-d5fe-454e-b648-87e916e29606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:12.539294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd3999-d5fe-454e-b648-87e916e29606 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.539579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd3999-d5fe-454e-b648-87e916e29606 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.539854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd3999-d5fe-454e-b648-87e916e29606 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.541116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd3999-d5fe-454e-b648-87e916e29606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:12.542744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd3999-d5fe-454e-b648-87e916e29606 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:12.544588 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 554/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:12.550584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eece9-9542-4d27-9d58-2cbd2acaf69c None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:12.651142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eece9-9542-4d27-9d58-2cbd2acaf69c None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:12.685828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8260c-6d76-4201-b573-f8c636c1da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:12.686886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8260c-6d76-4201-b573-f8c636c1da67 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:12.687171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8260c-6d76-4201-b573-f8c636c1da67 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:12.687445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8260c-6d76-4201-b573-f8c636c1da67 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:12.688097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8260c-6d76-4201-b573-f8c636c1da67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:12.689517 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8260c-6d76-4201-b573-f8c636c1da67 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:12.709341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 556/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:34:12 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:34:14.647525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f57c-a733-4e22-9176-73abd5012572 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:14.648167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f57c-a733-4e22-9176-73abd5012572 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:14.648167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f57c-a733-4e22-9176-73abd5012572 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:14.649431 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 555/1111] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:14.655502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8ddc-98ad-4b12-bc0d-d585dbfef1c4 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:14.655952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8ddc-98ad-4b12-bc0d-d585dbfef1c4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:14.656049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8ddc-98ad-4b12-bc0d-d585dbfef1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:14.674402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-dc6c8ddc-98ad-4b12-bc0d-d585dbfef1c4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:14.675619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-dc6c8ddc-98ad-4b12-bc0d-d585dbfef1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:14.724914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:14.742924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 557/1112] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:15.013730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5f57c-a733-4e22-9176-73abd5012572 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:15.114130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5f57c-a733-4e22-9176-73abd5012572 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:15.116475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:15.148504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc0537-db98-4df2-8a41-af5896999e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:15.149129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc0537-db98-4df2-8a41-af5896999e59 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:15.149517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc0537-db98-4df2-8a41-af5896999e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:15.149798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc0537-db98-4df2-8a41-af5896999e59 None admin] PATH_INFO: `/v3/roles/40201003f53c4077b8e412e7d4450cab` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:15.151231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc0537-db98-4df2-8a41-af5896999e59 None admin] RBAC: Authorizing `identity:get_role(role_id=40201003f53c4077b8e412e7d4450cab)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:15.152585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc0537-db98-4df2-8a41-af5896999e59 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:15.154446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 556/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:15 2022] GET /identity/v3/roles/40201003f53c4077b8e412e7d4450cab => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:15.160511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8ddc-98ad-4b12-bc0d-d585dbfef1c4 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:15.259744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8ddc-98ad-4b12-bc0d-d585dbfef1c4 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:15.293864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3770-855e-4ff2-9cff-6a24c8c8a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:15.294547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3770-855e-4ff2-9cff-6a24c8c8a537 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:15.294814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3770-855e-4ff2-9cff-6a24c8c8a537 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:15.295082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3770-855e-4ff2-9cff-6a24c8c8a537 None admin] PATH_INFO: `/v3/users/3f46145e5c944a7bb66c3db9815552ec` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:15.307602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c3770-855e-4ff2-9cff-6a24c8c8a537 None admin] RBAC: Authorizing `identity:get_user(user_id=3f46145e5c944a7bb66c3db9815552ec)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:15.309027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c3770-855e-4ff2-9cff-6a24c8c8a537 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:15.311168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 558/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:15 2022] GET /identity/v3/users/3f46145e5c944a7bb66c3db9815552ec => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:15.317226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc0537-db98-4df2-8a41-af5896999e59 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:15.422172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc0537-db98-4df2-8a41-af5896999e59 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:15.456962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902da1a-b0be-462a-a570-8244328618b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:15.457567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902da1a-b0be-462a-a570-8244328618b0 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:15.457849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902da1a-b0be-462a-a570-8244328618b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:15.458132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902da1a-b0be-462a-a570-8244328618b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:15.499154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:15.528703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902da1a-b0be-462a-a570-8244328618b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:15.530480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902da1a-b0be-462a-a570-8244328618b0 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:15.634052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 557/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:15.641797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3770-855e-4ff2-9cff-6a24c8c8a537 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:15.689815 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:15.744296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3770-855e-4ff2-9cff-6a24c8c8a537 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:15.779079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c885800-5bd4-4161-a2cb-c53d492c21da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:15.779676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885800-5bd4-4161-a2cb-c53d492c21da None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:15.780015 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885800-5bd4-4161-a2cb-c53d492c21da None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:15.780325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885800-5bd4-4161-a2cb-c53d492c21da None admin] PATH_INFO: `/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:15.781571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c885800-5bd4-4161-a2cb-c53d492c21da None admin] RBAC: Authorizing `identity:get_project(project_id=ea1b1b1d33b041fdaeabfc59f8ef2e3d)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:15.783145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c885800-5bd4-4161-a2cb-c53d492c21da None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:15.784953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 559/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:15 2022] GET /identity/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:15.791211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902da1a-b0be-462a-a570-8244328618b0 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:15.863766 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:15.894621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902da1a-b0be-462a-a570-8244328618b0 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:15.929254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145fd64-d7b2-4ac0-9997-76415aca4275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:15.929853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145fd64-d7b2-4ac0-9997-76415aca4275 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:15.930134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145fd64-d7b2-4ac0-9997-76415aca4275 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:15.930408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145fd64-d7b2-4ac0-9997-76415aca4275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:15.931159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145fd64-d7b2-4ac0-9997-76415aca4275 None admin] RBAC: Adding query filter params (role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=ea1b1b1d33b041fdaeabfc59f8ef2e3d, user.id=3f46145e5c944a7bb66c3db9815552ec) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:15.931530 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145fd64-d7b2-4ac0-9997-76415aca4275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:15.932898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145fd64-d7b2-4ac0-9997-76415aca4275 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:15.939022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 558/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:15 2022] GET /identity/v3/role_assignments?user.id=3f46145e5c944a7bb66c3db9815552ec&scope.project.id=ea1b1b1d33b041fdaeabfc59f8ef2e3d&role.id=40201003f53c4077b8e412e7d4450cab => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:17.831340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476db4c-a051-4c60-9503-b7e9d5dddfd9 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.831936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476db4c-a051-4c60-9503-b7e9d5dddfd9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.832165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476db4c-a051-4c60-9503-b7e9d5dddfd9 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.834101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 560/1118] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:17.841248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06c0d5-c945-4730-9367-e73458af21a2 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:17.841741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06c0d5-c945-4730-9367-e73458af21a2 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:17.842078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06c0d5-c945-4730-9367-e73458af21a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:17.860509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4e06c0d5-c945-4730-9367-e73458af21a2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:17.861725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4e06c0d5-c945-4730-9367-e73458af21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:17.936470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 559/1119] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:34:18.231394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476db4c-a051-4c60-9503-b7e9d5dddfd9 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.351736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476db4c-a051-4c60-9503-b7e9d5dddfd9 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.368468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:18.397929 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4565b37-fbe1-497e-a188-312d9d831613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.398565 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4565b37-fbe1-497e-a188-312d9d831613 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.398870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4565b37-fbe1-497e-a188-312d9d831613 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.399140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4565b37-fbe1-497e-a188-312d9d831613 None admin] PATH_INFO: `/v3/roles/40201003f53c4077b8e412e7d4450cab` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.401493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4565b37-fbe1-497e-a188-312d9d831613 None admin] RBAC: Authorizing `identity:get_role(role_id=40201003f53c4077b8e412e7d4450cab)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.402513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4565b37-fbe1-497e-a188-312d9d831613 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.404659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 561/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:18 2022] GET /identity/v3/roles/40201003f53c4077b8e412e7d4450cab => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:18.410327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06c0d5-c945-4730-9367-e73458af21a2 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.489309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:18.535004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06c0d5-c945-4730-9367-e73458af21a2 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.576731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fa32-0b34-451c-8a8c-dbdcb69b776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.577398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fa32-0b34-451c-8a8c-dbdcb69b776e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.577813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fa32-0b34-451c-8a8c-dbdcb69b776e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.578090 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fa32-0b34-451c-8a8c-dbdcb69b776e None admin] PATH_INFO: `/v3/users/3f46145e5c944a7bb66c3db9815552ec` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.579277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fa32-0b34-451c-8a8c-dbdcb69b776e None admin] RBAC: Authorizing `identity:get_user(user_id=3f46145e5c944a7bb66c3db9815552ec)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.580791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fa32-0b34-451c-8a8c-dbdcb69b776e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.583203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 560/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:18 2022] GET /identity/v3/users/3f46145e5c944a7bb66c3db9815552ec => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:34:18.589589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4565b37-fbe1-497e-a188-312d9d831613 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.702139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4565b37-fbe1-497e-a188-312d9d831613 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.735571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d25659-1033-4b94-badf-4e241e8c504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.736183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25659-1033-4b94-badf-4e241e8c504c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.736461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25659-1033-4b94-badf-4e241e8c504c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.736729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25659-1033-4b94-badf-4e241e8c504c None admin] PATH_INFO: `/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.737826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d25659-1033-4b94-badf-4e241e8c504c None admin] RBAC: Authorizing `identity:get_project(project_id=ea1b1b1d33b041fdaeabfc59f8ef2e3d)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.739283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d25659-1033-4b94-badf-4e241e8c504c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.740971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 562/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:18 2022] GET /identity/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:18.746963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fa32-0b34-451c-8a8c-dbdcb69b776e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:18.847696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fa32-0b34-451c-8a8c-dbdcb69b776e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:18.882426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db60d8c-4de1-4061-bd67-4c354560bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:18.883120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db60d8c-4de1-4061-bd67-4c354560bffa None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:18.883404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db60d8c-4de1-4061-bd67-4c354560bffa None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:18.883679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db60d8c-4de1-4061-bd67-4c354560bffa None admin] PATH_INFO: `/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d/users/3f46145e5c944a7bb66c3db9815552ec/roles/40201003f53c4077b8e412e7d4450cab` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:18.886095 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db60d8c-4de1-4061-bd67-4c354560bffa None admin] RBAC: Authorizing `identity:create_grant(project_id=ea1b1b1d33b041fdaeabfc59f8ef2e3d, user_id=3f46145e5c944a7bb66c3db9815552ec, role_id=40201003f53c4077b8e412e7d4450cab)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:18.887557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db60d8c-4de1-4061-bd67-4c354560bffa None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:18.890472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:18.901105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 561/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:34:18 2022] PUT /identity/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d/users/3f46145e5c944a7bb66c3db9815552ec/roles/40201003f53c4077b8e412e7d4450cab => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:20.939928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6937-ce73-4e57-8cf9-102e0aa89fe1 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:20.940457 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6937-ce73-4e57-8cf9-102e0aa89fe1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:20.940580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6937-ce73-4e57-8cf9-102e0aa89fe1 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:20.942021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 563/1124] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:20.947226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a869e38-0bd1-4116-84b9-340cfa8f4066 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:20.947684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a869e38-0bd1-4116-84b9-340cfa8f4066 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:20.947782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a869e38-0bd1-4116-84b9-340cfa8f4066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:20.965469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-7a869e38-0bd1-4116-84b9-340cfa8f4066 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:20.966909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7a869e38-0bd1-4116-84b9-340cfa8f4066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:21.032525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 562/1125] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:21.306738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6937-ce73-4e57-8cf9-102e0aa89fe1 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:21.355810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:21.407396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6937-ce73-4e57-8cf9-102e0aa89fe1 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:21.439880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4c6b5-ae11-4e3d-87d1-ce677ff8a855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:21.440499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4c6b5-ae11-4e3d-87d1-ce677ff8a855 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:21.440774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4c6b5-ae11-4e3d-87d1-ce677ff8a855 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:21.441038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4c6b5-ae11-4e3d-87d1-ce677ff8a855 None admin] PATH_INFO: `/v3/roles/40201003f53c4077b8e412e7d4450cab` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:21.442395 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4c6b5-ae11-4e3d-87d1-ce677ff8a855 None admin] RBAC: Authorizing `identity:get_role(role_id=40201003f53c4077b8e412e7d4450cab)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:21.443772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4c6b5-ae11-4e3d-87d1-ce677ff8a855 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:21.445096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 564/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:21 2022] GET /identity/v3/roles/40201003f53c4077b8e412e7d4450cab => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:21.451488 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a869e38-0bd1-4116-84b9-340cfa8f4066 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:21.550152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a869e38-0bd1-4116-84b9-340cfa8f4066 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:21.573655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:21.585947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d3a93-3e0c-4799-9d21-ccfaf40f5615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:21.586576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d3a93-3e0c-4799-9d21-ccfaf40f5615 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:21.586884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d3a93-3e0c-4799-9d21-ccfaf40f5615 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:21.587160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d3a93-3e0c-4799-9d21-ccfaf40f5615 None admin] PATH_INFO: `/v3/users/3f46145e5c944a7bb66c3db9815552ec` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:21.588268 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d3a93-3e0c-4799-9d21-ccfaf40f5615 None admin] RBAC: Authorizing `identity:get_user(user_id=3f46145e5c944a7bb66c3db9815552ec)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:21.589691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d3a93-3e0c-4799-9d21-ccfaf40f5615 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:21.591698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 563/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:21 2022] GET /identity/v3/users/3f46145e5c944a7bb66c3db9815552ec => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:21.597539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4c6b5-ae11-4e3d-87d1-ce677ff8a855 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:21.696506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4c6b5-ae11-4e3d-87d1-ce677ff8a855 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:21.715766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:21.741864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebfaa8-a18f-42ac-a1ea-ea29723e6c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:21.742742 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebfaa8-a18f-42ac-a1ea-ea29723e6c53 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:21.743209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebfaa8-a18f-42ac-a1ea-ea29723e6c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:21.743628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebfaa8-a18f-42ac-a1ea-ea29723e6c53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:21.822435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebfaa8-a18f-42ac-a1ea-ea29723e6c53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:21.823949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebfaa8-a18f-42ac-a1ea-ea29723e6c53 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:21.919488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 565/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:21.925641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d3a93-3e0c-4799-9d21-ccfaf40f5615 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:22.036726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d3a93-3e0c-4799-9d21-ccfaf40f5615 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:22.079469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9ba2-980a-41d8-9353-70267d672e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:22.080021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9ba2-980a-41d8-9353-70267d672e30 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.080303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9ba2-980a-41d8-9353-70267d672e30 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.080580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9ba2-980a-41d8-9353-70267d672e30 None admin] PATH_INFO: `/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.081732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9ba2-980a-41d8-9353-70267d672e30 None admin] RBAC: Authorizing `identity:get_project(project_id=ea1b1b1d33b041fdaeabfc59f8ef2e3d)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:22.083238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9ba2-980a-41d8-9353-70267d672e30 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:22.084923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 564/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:21 2022] GET /identity/v3/projects/ea1b1b1d33b041fdaeabfc59f8ef2e3d => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:22.091973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebfaa8-a18f-42ac-a1ea-ea29723e6c53 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:22.112027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:22.198325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebfaa8-a18f-42ac-a1ea-ea29723e6c53 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:22.232898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf03dbf-d6c2-483b-8236-790a5dc34d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:22.233496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03dbf-d6c2-483b-8236-790a5dc34d27 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:22.233777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03dbf-d6c2-483b-8236-790a5dc34d27 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:22.234048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03dbf-d6c2-483b-8236-790a5dc34d27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:22.234803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf03dbf-d6c2-483b-8236-790a5dc34d27 None admin] RBAC: Adding query filter params (role.id=40201003f53c4077b8e412e7d4450cab, scope.project.id=ea1b1b1d33b041fdaeabfc59f8ef2e3d, user.id=3f46145e5c944a7bb66c3db9815552ec) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:22.235107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf03dbf-d6c2-483b-8236-790a5dc34d27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:22.236523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf03dbf-d6c2-483b-8236-790a5dc34d27 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:22.242299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 566/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:22 2022] GET /identity/v3/role_assignments?user.id=3f46145e5c944a7bb66c3db9815552ec&scope.project.id=ea1b1b1d33b041fdaeabfc59f8ef2e3d&role.id=40201003f53c4077b8e412e7d4450cab => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:24.165332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60980141-30a0-40b3-990d-72295786a75d None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.165876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60980141-30a0-40b3-990d-72295786a75d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.165876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60980141-30a0-40b3-990d-72295786a75d None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.167286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 565/1131] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:24.172733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14332ce-f7e1-4b00-afe0-e1aa23b1fc47 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.173159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14332ce-f7e1-4b00-afe0-e1aa23b1fc47 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.173291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14332ce-f7e1-4b00-afe0-e1aa23b1fc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.191436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b14332ce-f7e1-4b00-afe0-e1aa23b1fc47 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:24.192574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b14332ce-f7e1-4b00-afe0-e1aa23b1fc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:24.260581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 567/1132] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:24.530308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60980141-30a0-40b3-990d-72295786a75d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.590413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:24.631814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60980141-30a0-40b3-990d-72295786a75d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.665381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf60e21-e323-46ab-95bd-2ed02c3beccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.665999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf60e21-e323-46ab-95bd-2ed02c3beccf None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.666276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf60e21-e323-46ab-95bd-2ed02c3beccf None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.666547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf60e21-e323-46ab-95bd-2ed02c3beccf None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.667684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf60e21-e323-46ab-95bd-2ed02c3beccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.669758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf60e21-e323-46ab-95bd-2ed02c3beccf None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.671534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 566/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:24.677439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14332ce-f7e1-4b00-afe0-e1aa23b1fc47 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:24.689451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:24.779300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14332ce-f7e1-4b00-afe0-e1aa23b1fc47 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:24.813411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983da8-b9a0-44f3-a6e7-46cd2e899552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:24.813958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983da8-b9a0-44f3-a6e7-46cd2e899552 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:24.814241 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983da8-b9a0-44f3-a6e7-46cd2e899552 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:24.814516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983da8-b9a0-44f3-a6e7-46cd2e899552 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:24.815201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f983da8-b9a0-44f3-a6e7-46cd2e899552 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:24.816624 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f983da8-b9a0-44f3-a6e7-46cd2e899552 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:24.845816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 568/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:34:24 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:26.830617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dd0df-83a2-4765-800f-243fec282951 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.831224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dd0df-83a2-4765-800f-243fec282951 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.831224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dd0df-83a2-4765-800f-243fec282951 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.832556 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 567/1135] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:26.838201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2565b8-31bf-4789-924c-ff7828ce7f3d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:26.838626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2565b8-31bf-4789-924c-ff7828ce7f3d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:26.838754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2565b8-31bf-4789-924c-ff7828ce7f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:26.857728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6c2565b8-31bf-4789-924c-ff7828ce7f3d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:26.858969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6c2565b8-31bf-4789-924c-ff7828ce7f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:26.917156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:26.929161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 569/1136] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:27.203739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dd0df-83a2-4765-800f-243fec282951 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:27.307182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dd0df-83a2-4765-800f-243fec282951 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:27.334255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:27.343367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94459c-e24f-41c6-8f0c-caedeca49a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:27.343996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94459c-e24f-41c6-8f0c-caedeca49a5f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.344276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94459c-e24f-41c6-8f0c-caedeca49a5f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.344550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94459c-e24f-41c6-8f0c-caedeca49a5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.345663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94459c-e24f-41c6-8f0c-caedeca49a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:27.347156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94459c-e24f-41c6-8f0c-caedeca49a5f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:27.348723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 568/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:27.354525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2565b8-31bf-4789-924c-ff7828ce7f3d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:27.456507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2565b8-31bf-4789-924c-ff7828ce7f3d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:27.492457 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a533bd-c055-4d46-843b-8a11406a1f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:27.493090 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a533bd-c055-4d46-843b-8a11406a1f23 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:27.493364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a533bd-c055-4d46-843b-8a11406a1f23 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:27.493635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a533bd-c055-4d46-843b-8a11406a1f23 None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:27.494276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a533bd-c055-4d46-843b-8a11406a1f23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:27.495726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a533bd-c055-4d46-843b-8a11406a1f23 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:27.517959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 570/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:34:27 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:29.481951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac16c8-edde-4e8c-9087-401fd63e219a None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:29.482509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac16c8-edde-4e8c-9087-401fd63e219a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:29.482509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac16c8-edde-4e8c-9087-401fd63e219a None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:29.483852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 569/1139] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:29.489110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc4a14-a265-43e3-876e-f9c44aab7369 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:29.489527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc4a14-a265-43e3-876e-f9c44aab7369 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:29.489640 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc4a14-a265-43e3-876e-f9c44aab7369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:29.508003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d2bc4a14-a265-43e3-876e-f9c44aab7369 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:29.509177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d2bc4a14-a265-43e3-876e-f9c44aab7369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:29.553034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:29.576995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 571/1140] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:29.853510 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac16c8-edde-4e8c-9087-401fd63e219a None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:29.955829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac16c8-edde-4e8c-9087-401fd63e219a None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:29.989382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8281db-fc08-4886-831a-15545d553dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:29.989997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8281db-fc08-4886-831a-15545d553dcb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:29.990272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8281db-fc08-4886-831a-15545d553dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:29.990542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8281db-fc08-4886-831a-15545d553dcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:30.000630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8281db-fc08-4886-831a-15545d553dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-2b8281db-fc08-4886-831a-15545d553dcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:30.005196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:30.006558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:30.007700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 570/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:34:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:30.013203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc4a14-a265-43e3-876e-f9c44aab7369 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:30.110694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc4a14-a265-43e3-876e-f9c44aab7369 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:30.145273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ca370-46ee-4443-b447-d5b305a88303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:30.145875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ca370-46ee-4443-b447-d5b305a88303 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:30.146157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ca370-46ee-4443-b447-d5b305a88303 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:30.146425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ca370-46ee-4443-b447-d5b305a88303 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:30.147115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ca370-46ee-4443-b447-d5b305a88303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:30.147420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ca370-46ee-4443-b447-d5b305a88303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:30.148776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ca370-46ee-4443-b447-d5b305a88303 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:30.157750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 572/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:30.163623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8281db-fc08-4886-831a-15545d553dcb None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:30.223999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:30.268964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8281db-fc08-4886-831a-15545d553dcb None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:30.303271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97769bfc-10f3-4a09-9915-8dcda3219244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:30.303884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97769bfc-10f3-4a09-9915-8dcda3219244 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:30.304158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97769bfc-10f3-4a09-9915-8dcda3219244 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:30.304428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97769bfc-10f3-4a09-9915-8dcda3219244 None admin] PATH_INFO: `/v3/users/ceca5dd08c1d4f9780dc6583d556b8fc` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:30.317368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97769bfc-10f3-4a09-9915-8dcda3219244 None admin] RBAC: Authorizing `identity:get_user(user_id=ceca5dd08c1d4f9780dc6583d556b8fc)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:30.318821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97769bfc-10f3-4a09-9915-8dcda3219244 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:30.320432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 571/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:30 2022] GET /identity/v3/users/ceca5dd08c1d4f9780dc6583d556b8fc => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:30.326607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ca370-46ee-4443-b447-d5b305a88303 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:30.369521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:30.427843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ca370-46ee-4443-b447-d5b305a88303 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:30.460694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1617b9-d25d-41a3-a283-4c0e1ec35f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:30.461288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1617b9-d25d-41a3-a283-4c0e1ec35f4b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:30.461570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1617b9-d25d-41a3-a283-4c0e1ec35f4b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:30.461843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1617b9-d25d-41a3-a283-4c0e1ec35f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:30.529224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1617b9-d25d-41a3-a283-4c0e1ec35f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:30.530671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1617b9-d25d-41a3-a283-4c0e1ec35f4b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:30.570025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:30.628008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 573/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:30.633851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97769bfc-10f3-4a09-9915-8dcda3219244 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:30.734390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97769bfc-10f3-4a09-9915-8dcda3219244 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:30.748612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:30.772174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fb0a0-87d4-4302-97ad-056038d3c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:30.772811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fb0a0-87d4-4302-97ad-056038d3c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:30.773307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fb0a0-87d4-4302-97ad-056038d3c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:30.773818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fb0a0-87d4-4302-97ad-056038d3c5d5 None admin] PATH_INFO: `/v3/projects/a4f2c7d1580f45f2bf2d5db6f0cb1ab5` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:30.775798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fb0a0-87d4-4302-97ad-056038d3c5d5 None admin] RBAC: Authorizing `identity:get_project(project_id=a4f2c7d1580f45f2bf2d5db6f0cb1ab5)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:30.777387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fb0a0-87d4-4302-97ad-056038d3c5d5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:30.779380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 572/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:30 2022] GET /identity/v3/projects/a4f2c7d1580f45f2bf2d5db6f0cb1ab5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:30.786813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1617b9-d25d-41a3-a283-4c0e1ec35f4b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:30.890085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1617b9-d25d-41a3-a283-4c0e1ec35f4b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:30.923764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670708bd-c73e-4100-8750-4ef5776b772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:30.924357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670708bd-c73e-4100-8750-4ef5776b772b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:30.924639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670708bd-c73e-4100-8750-4ef5776b772b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:30.924911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670708bd-c73e-4100-8750-4ef5776b772b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:30.925628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670708bd-c73e-4100-8750-4ef5776b772b None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=a4f2c7d1580f45f2bf2d5db6f0cb1ab5, user.id=ceca5dd08c1d4f9780dc6583d556b8fc) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:30.925941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670708bd-c73e-4100-8750-4ef5776b772b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:30.927403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670708bd-c73e-4100-8750-4ef5776b772b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:30.932844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 574/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:30 2022] GET /identity/v3/role_assignments?user.id=ceca5dd08c1d4f9780dc6583d556b8fc&scope.project.id=a4f2c7d1580f45f2bf2d5db6f0cb1ab5&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:32.814217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb35e3-8f48-493d-85b4-6d71c378e319 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:32.814949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb35e3-8f48-493d-85b4-6d71c378e319 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:32.814949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb35e3-8f48-493d-85b4-6d71c378e319 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:32.816132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 573/1147] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:32.821706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2113565-73b7-4439-ba75-ebe0cf8c6a29 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:32.822152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2113565-73b7-4439-ba75-ebe0cf8c6a29 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:32.822252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2113565-73b7-4439-ba75-ebe0cf8c6a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:32.830316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:32.842114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b2113565-73b7-4439-ba75-ebe0cf8c6a29 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:32.843361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b2113565-73b7-4439-ba75-ebe0cf8c6a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:32.909966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 575/1148] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:33.187964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb35e3-8f48-493d-85b4-6d71c378e319 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.288684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb35e3-8f48-493d-85b4-6d71c378e319 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:33.322344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2546c96-cec9-43db-96f4-8f65c49fe173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:33.322990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2546c96-cec9-43db-96f4-8f65c49fe173 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.323271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2546c96-cec9-43db-96f4-8f65c49fe173 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.323544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2546c96-cec9-43db-96f4-8f65c49fe173 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.334180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2546c96-cec9-43db-96f4-8f65c49fe173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-e2546c96-cec9-43db-96f4-8f65c49fe173 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:33.338822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:33.339929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:33.341790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 574/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:33.346989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2113565-73b7-4439-ba75-ebe0cf8c6a29 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.442167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2113565-73b7-4439-ba75-ebe0cf8c6a29 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:33.477284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99628b93-0110-4d5c-ad5e-b1b944d7138b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:33.477895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99628b93-0110-4d5c-ad5e-b1b944d7138b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.478171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99628b93-0110-4d5c-ad5e-b1b944d7138b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.478435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99628b93-0110-4d5c-ad5e-b1b944d7138b None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.479128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99628b93-0110-4d5c-ad5e-b1b944d7138b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:33.479423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99628b93-0110-4d5c-ad5e-b1b944d7138b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:33.480781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99628b93-0110-4d5c-ad5e-b1b944d7138b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:33.482826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:33.491637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 576/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:33.498024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2546c96-cec9-43db-96f4-8f65c49fe173 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.549078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:33.606037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2546c96-cec9-43db-96f4-8f65c49fe173 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:33.640742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535ace-b3b4-44ab-bf26-53534a548f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:33.641362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535ace-b3b4-44ab-bf26-53534a548f49 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.641643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535ace-b3b4-44ab-bf26-53534a548f49 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.641918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535ace-b3b4-44ab-bf26-53534a548f49 None admin] PATH_INFO: `/v3/users/ceca5dd08c1d4f9780dc6583d556b8fc` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.643066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6535ace-b3b4-44ab-bf26-53534a548f49 None admin] RBAC: Authorizing `identity:get_user(user_id=ceca5dd08c1d4f9780dc6583d556b8fc)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:33.644502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6535ace-b3b4-44ab-bf26-53534a548f49 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:33.646088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 575/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:33 2022] GET /identity/v3/users/ceca5dd08c1d4f9780dc6583d556b8fc => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:33.652091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99628b93-0110-4d5c-ad5e-b1b944d7138b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.750794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99628b93-0110-4d5c-ad5e-b1b944d7138b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:33.783756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4184c71-981a-45e4-82b1-2adbb4c003ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:33.784369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4184c71-981a-45e4-82b1-2adbb4c003ff None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.784649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4184c71-981a-45e4-82b1-2adbb4c003ff None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.784919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4184c71-981a-45e4-82b1-2adbb4c003ff None admin] PATH_INFO: `/v3/projects/a4f2c7d1580f45f2bf2d5db6f0cb1ab5` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.786012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4184c71-981a-45e4-82b1-2adbb4c003ff None admin] RBAC: Authorizing `identity:get_project(project_id=a4f2c7d1580f45f2bf2d5db6f0cb1ab5)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:33.787458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4184c71-981a-45e4-82b1-2adbb4c003ff None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:33.789240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 577/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:33 2022] GET /identity/v3/projects/a4f2c7d1580f45f2bf2d5db6f0cb1ab5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:33.795482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535ace-b3b4-44ab-bf26-53534a548f49 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:33.901419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535ace-b3b4-44ab-bf26-53534a548f49 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:33.912346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:33.936449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691d582-c1ab-4f7e-91f7-8a5bdbe7883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:33.937133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691d582-c1ab-4f7e-91f7-8a5bdbe7883b None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:33.937415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691d582-c1ab-4f7e-91f7-8a5bdbe7883b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:33.937688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691d582-c1ab-4f7e-91f7-8a5bdbe7883b None admin] PATH_INFO: `/v3/projects/a4f2c7d1580f45f2bf2d5db6f0cb1ab5/users/ceca5dd08c1d4f9780dc6583d556b8fc/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:33.939621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691d582-c1ab-4f7e-91f7-8a5bdbe7883b None admin] RBAC: Authorizing `identity:create_grant(project_id=a4f2c7d1580f45f2bf2d5db6f0cb1ab5, user_id=ceca5dd08c1d4f9780dc6583d556b8fc, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:33.941062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691d582-c1ab-4f7e-91f7-8a5bdbe7883b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:33.955477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 576/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:34:33 2022] PUT /identity/v3/projects/a4f2c7d1580f45f2bf2d5db6f0cb1ab5/users/ceca5dd08c1d4f9780dc6583d556b8fc/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:35.874803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099a905-9289-4a42-a07d-df9fc062b666 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:35.875351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099a905-9289-4a42-a07d-df9fc062b666 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:35.875351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099a905-9289-4a42-a07d-df9fc062b666 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:35.876712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 578/1154] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:35.882360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e15200-a172-4328-b2df-f23f25084b58 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:35.882839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e15200-a172-4328-b2df-f23f25084b58 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:35.882982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e15200-a172-4328-b2df-f23f25084b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:35.901634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-96e15200-a172-4328-b2df-f23f25084b58 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:35.902884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-96e15200-a172-4328-b2df-f23f25084b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:35.970485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 577/1155] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:34:36.238393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099a905-9289-4a42-a07d-df9fc062b666 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:36.301914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:36.343969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099a905-9289-4a42-a07d-df9fc062b666 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:36.377212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacedec7-037c-4f54-80bf-2e9b51f77ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:36.377825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacedec7-037c-4f54-80bf-2e9b51f77ef9 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:36.378101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacedec7-037c-4f54-80bf-2e9b51f77ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:36.378367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacedec7-037c-4f54-80bf-2e9b51f77ef9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:36.389293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacedec7-037c-4f54-80bf-2e9b51f77ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-aacedec7-037c-4f54-80bf-2e9b51f77ef9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:36.393875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:36.395016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:36.395874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 579/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:36.401276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e15200-a172-4328-b2df-f23f25084b58 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:36.495442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:36.498632 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e15200-a172-4328-b2df-f23f25084b58 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:36.535026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a044b5-9d76-4f59-8b11-779caed30f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:36.535634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a044b5-9d76-4f59-8b11-779caed30f3e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:36.535914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a044b5-9d76-4f59-8b11-779caed30f3e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:36.536189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a044b5-9d76-4f59-8b11-779caed30f3e None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:36.536848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a044b5-9d76-4f59-8b11-779caed30f3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:36.537151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a044b5-9d76-4f59-8b11-779caed30f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:36.538521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a044b5-9d76-4f59-8b11-779caed30f3e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:36.547017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 578/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:36.552727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacedec7-037c-4f54-80bf-2e9b51f77ef9 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:36.661890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacedec7-037c-4f54-80bf-2e9b51f77ef9 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:36.685223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:36.696212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb45e-c8f8-46ac-a4ce-6c8fdd78be96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:36.696836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb45e-c8f8-46ac-a4ce-6c8fdd78be96 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:36.697118 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb45e-c8f8-46ac-a4ce-6c8fdd78be96 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:36.697391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb45e-c8f8-46ac-a4ce-6c8fdd78be96 None admin] PATH_INFO: `/v3/users/ceca5dd08c1d4f9780dc6583d556b8fc` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:36.698509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fb45e-c8f8-46ac-a4ce-6c8fdd78be96 None admin] RBAC: Authorizing `identity:get_user(user_id=ceca5dd08c1d4f9780dc6583d556b8fc)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:36.700955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fb45e-c8f8-46ac-a4ce-6c8fdd78be96 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:36.702540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 580/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:36 2022] GET /identity/v3/users/ceca5dd08c1d4f9780dc6583d556b8fc => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:36.708516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a044b5-9d76-4f59-8b11-779caed30f3e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:36.818858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a044b5-9d76-4f59-8b11-779caed30f3e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:36.853073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034b0d-87c9-4e4c-a1c0-2843d3753a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:36.853764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034b0d-87c9-4e4c-a1c0-2843d3753a4f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:36.853966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034b0d-87c9-4e4c-a1c0-2843d3753a4f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:36.854284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034b0d-87c9-4e4c-a1c0-2843d3753a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:36.885809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:36.924943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc034b0d-87c9-4e4c-a1c0-2843d3753a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:36.926490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc034b0d-87c9-4e4c-a1c0-2843d3753a4f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.027485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 579/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:37.033569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb45e-c8f8-46ac-a4ce-6c8fdd78be96 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:37.134866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb45e-c8f8-46ac-a4ce-6c8fdd78be96 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.170812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299bf96-1a15-48c8-b69c-0ff7b9c4852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.171451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299bf96-1a15-48c8-b69c-0ff7b9c4852d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.171728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299bf96-1a15-48c8-b69c-0ff7b9c4852d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.172196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299bf96-1a15-48c8-b69c-0ff7b9c4852d None admin] PATH_INFO: `/v3/projects/a4f2c7d1580f45f2bf2d5db6f0cb1ab5` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.173320 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299bf96-1a15-48c8-b69c-0ff7b9c4852d None admin] RBAC: Authorizing `identity:get_project(project_id=a4f2c7d1580f45f2bf2d5db6f0cb1ab5)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.174733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299bf96-1a15-48c8-b69c-0ff7b9c4852d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.176400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 581/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:37 2022] GET /identity/v3/projects/a4f2c7d1580f45f2bf2d5db6f0cb1ab5 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:37.182743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034b0d-87c9-4e4c-a1c0-2843d3753a4f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:37.244005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:37.282831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034b0d-87c9-4e4c-a1c0-2843d3753a4f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:37.316603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d49ba-3ad2-4e5b-a921-0c5452a282cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:37.317200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d49ba-3ad2-4e5b-a921-0c5452a282cc None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:37.317479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d49ba-3ad2-4e5b-a921-0c5452a282cc None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:37.317752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d49ba-3ad2-4e5b-a921-0c5452a282cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:37.318472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d49ba-3ad2-4e5b-a921-0c5452a282cc None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=a4f2c7d1580f45f2bf2d5db6f0cb1ab5, user.id=ceca5dd08c1d4f9780dc6583d556b8fc) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:37.318802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d49ba-3ad2-4e5b-a921-0c5452a282cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:37.320224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d49ba-3ad2-4e5b-a921-0c5452a282cc None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:37.325955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 580/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:37 2022] GET /identity/v3/role_assignments?user.id=ceca5dd08c1d4f9780dc6583d556b8fc&scope.project.id=a4f2c7d1580f45f2bf2d5db6f0cb1ab5&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:39.284502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a88c47-aae3-4cd6-a4d6-425643b69f91 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:39.285023 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a88c47-aae3-4cd6-a4d6-425643b69f91 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:39.285023 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a88c47-aae3-4cd6-a4d6-425643b69f91 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:39.286348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 582/1162] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:39.291689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c716c-e7b4-4da6-8dce-4e9708281d59 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:39.292066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c716c-e7b4-4da6-8dce-4e9708281d59 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:39.292247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c716c-e7b4-4da6-8dce-4e9708281d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:39.310636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c58c716c-e7b4-4da6-8dce-4e9708281d59 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:39.311864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c58c716c-e7b4-4da6-8dce-4e9708281d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:39.380678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 581/1163] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:34:39.652828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a88c47-aae3-4cd6-a4d6-425643b69f91 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:39.712216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:39.755081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a88c47-aae3-4cd6-a4d6-425643b69f91 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:39.788464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edefc45-2709-4a07-bf44-1e590d05f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:39.789064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edefc45-2709-4a07-bf44-1e590d05f09c None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:39.789341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edefc45-2709-4a07-bf44-1e590d05f09c None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:39.789611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edefc45-2709-4a07-bf44-1e590d05f09c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:39.857534 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edefc45-2709-4a07-bf44-1e590d05f09c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:39.859064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edefc45-2709-4a07-bf44-1e590d05f09c None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:39.915584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:39.958730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 583/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:39.964695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c716c-e7b4-4da6-8dce-4e9708281d59 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:40.021096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:40.066132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c716c-e7b4-4da6-8dce-4e9708281d59 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:40.101009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf80ff8-93fc-4286-aef6-2cecd265af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:40.101753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf80ff8-93fc-4286-aef6-2cecd265af2e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:40.102016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf80ff8-93fc-4286-aef6-2cecd265af2e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:40.102294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf80ff8-93fc-4286-aef6-2cecd265af2e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:40.109226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf80ff8-93fc-4286-aef6-2cecd265af2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:40.110667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf80ff8-93fc-4286-aef6-2cecd265af2e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-faf80ff8-93fc-4286-aef6-2cecd265af2e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:40.122118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:40.123382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:40.124407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 582/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:34:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:40.129288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edefc45-2709-4a07-bf44-1e590d05f09c None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:40.228332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edefc45-2709-4a07-bf44-1e590d05f09c None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:40.263944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7b62a-88c9-4bd8-99da-7c06279d6ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:40.264539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7b62a-88c9-4bd8-99da-7c06279d6ccc None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:40.264824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7b62a-88c9-4bd8-99da-7c06279d6ccc None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:40.265097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7b62a-88c9-4bd8-99da-7c06279d6ccc None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:40.265739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7b62a-88c9-4bd8-99da-7c06279d6ccc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:40.266044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7b62a-88c9-4bd8-99da-7c06279d6ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:40.267432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7b62a-88c9-4bd8-99da-7c06279d6ccc None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:40.274521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 584/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 11:34:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:42.186039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270040f-4c89-4632-8d60-911aa4c03eb6 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:42.186557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270040f-4c89-4632-8d60-911aa4c03eb6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:42.186649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270040f-4c89-4632-8d60-911aa4c03eb6 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:42.187983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 583/1167] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:42.193415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0569e5-ad3f-4ba8-a4ee-98cdda6da112 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:42.193834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0569e5-ad3f-4ba8-a4ee-98cdda6da112 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:42.193926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0569e5-ad3f-4ba8-a4ee-98cdda6da112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:42.212622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6e0569e5-ad3f-4ba8-a4ee-98cdda6da112 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:42.213813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6e0569e5-ad3f-4ba8-a4ee-98cdda6da112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:42.232383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:42.286530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 585/1168] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:42.566699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270040f-4c89-4632-8d60-911aa4c03eb6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:42.674007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270040f-4c89-4632-8d60-911aa4c03eb6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:42.690735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:42.709072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd906f4-98d0-4781-af98-f253c8a45390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:42.709668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd906f4-98d0-4781-af98-f253c8a45390 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:42.709945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd906f4-98d0-4781-af98-f253c8a45390 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:42.710214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd906f4-98d0-4781-af98-f253c8a45390 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:42.710915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd906f4-98d0-4781-af98-f253c8a45390 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:42.712280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd906f4-98d0-4781-af98-f253c8a45390 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:42.727434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 584/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Wed Aug 24 11:34:42 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:44.651215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7111b8-d80f-44b6-8d2e-cdde49702fb4 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:44.651844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7111b8-d80f-44b6-8d2e-cdde49702fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:44.651844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7111b8-d80f-44b6-8d2e-cdde49702fb4 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:44.653124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 586/1170] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:44.658322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6036d-f7d0-4293-9e1a-41101adc4c19 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:44.658756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6036d-f7d0-4293-9e1a-41101adc4c19 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:44.658926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6036d-f7d0-4293-9e1a-41101adc4c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:44.677383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-19e6036d-f7d0-4293-9e1a-41101adc4c19 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:44.678572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-19e6036d-f7d0-4293-9e1a-41101adc4c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:44.743990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 585/1171] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:45.017716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7111b8-d80f-44b6-8d2e-cdde49702fb4 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:45.115233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7111b8-d80f-44b6-8d2e-cdde49702fb4 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:45.149443 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c4511-b1e6-4de1-914a-fbf1d1106534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:45.150079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c4511-b1e6-4de1-914a-fbf1d1106534 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:45.150345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c4511-b1e6-4de1-914a-fbf1d1106534 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:45.150616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c4511-b1e6-4de1-914a-fbf1d1106534 None admin] PATH_INFO: `/v3/domains/7db38392a7b842a4bb25d37f2a9d127b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:45.162272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c4511-b1e6-4de1-914a-fbf1d1106534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7db38392a7b842a4bb25d37f2a9d127b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:45.163752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c4511-b1e6-4de1-914a-fbf1d1106534 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:45.165444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 587/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Wed Aug 24 11:34:45 2022] GET /identity/v3/domains/7db38392a7b842a4bb25d37f2a9d127b => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:45.171432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6036d-f7d0-4293-9e1a-41101adc4c19 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:45.270872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6036d-f7d0-4293-9e1a-41101adc4c19 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:45.278097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:45.306011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cc796-7775-49a6-accf-d8d79eb9f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:45.306616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cc796-7775-49a6-accf-d8d79eb9f38b None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:45.306945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cc796-7775-49a6-accf-d8d79eb9f38b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:45.307223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cc796-7775-49a6-accf-d8d79eb9f38b None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:45.307864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cc796-7775-49a6-accf-d8d79eb9f38b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:45.309882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cc796-7775-49a6-accf-d8d79eb9f38b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:45.335751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 586/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:34:45 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:47.269794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84248-7dba-434a-abcb-4c37b040fc34 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:47.270308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84248-7dba-434a-abcb-4c37b040fc34 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:47.270308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84248-7dba-434a-abcb-4c37b040fc34 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:47.271651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 588/1174] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:47.276797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4609ec-3840-45c0-a39d-7765530695c3 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:47.278005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4609ec-3840-45c0-a39d-7765530695c3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:47.278005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4609ec-3840-45c0-a39d-7765530695c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:47.296522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ac4609ec-3840-45c0-a39d-7765530695c3 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:47.297701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ac4609ec-3840-45c0-a39d-7765530695c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:47.361981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 587/1175] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:47.630932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df84248-7dba-434a-abcb-4c37b040fc34 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:47.648446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:47.734310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df84248-7dba-434a-abcb-4c37b040fc34 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:47.768129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297dd6a-048c-4a9e-8db8-1f2b4e123bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:47.768744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297dd6a-048c-4a9e-8db8-1f2b4e123bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:47.769024 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297dd6a-048c-4a9e-8db8-1f2b4e123bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:47.769293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297dd6a-048c-4a9e-8db8-1f2b4e123bf4 None admin] PATH_INFO: `/v3/domains/7db38392a7b842a4bb25d37f2a9d127b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:47.770393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297dd6a-048c-4a9e-8db8-1f2b4e123bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7db38392a7b842a4bb25d37f2a9d127b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:47.771845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297dd6a-048c-4a9e-8db8-1f2b4e123bf4 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:47.773415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 589/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Wed Aug 24 11:34:47 2022] GET /identity/v3/domains/7db38392a7b842a4bb25d37f2a9d127b => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:47.779372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4609ec-3840-45c0-a39d-7765530695c3 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:47.867186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:47.880853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4609ec-3840-45c0-a39d-7765530695c3 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:47.915607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6f75d-1aff-47a4-ab5b-a1e37d355939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:47.916144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f75d-1aff-47a4-ab5b-a1e37d355939 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:47.916429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f75d-1aff-47a4-ab5b-a1e37d355939 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:47.916706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f75d-1aff-47a4-ab5b-a1e37d355939 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:47.917359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6f75d-1aff-47a4-ab5b-a1e37d355939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:47.919043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6f75d-1aff-47a4-ab5b-a1e37d355939 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:47.942829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 588/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:34:47 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:34:49.942672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a235ff8-35e5-49e4-8a1c-fe753881c028 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:49.943281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a235ff8-35e5-49e4-8a1c-fe753881c028 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:49.943281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a235ff8-35e5-49e4-8a1c-fe753881c028 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:49.944616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 590/1178] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:49.950508 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5d516-8e39-4166-9850-85ca0b375d3b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:49.950970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5d516-8e39-4166-9850-85ca0b375d3b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:49.951094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5d516-8e39-4166-9850-85ca0b375d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:49.969570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-aef5d516-8e39-4166-9850-85ca0b375d3b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:49.970800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-aef5d516-8e39-4166-9850-85ca0b375d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:50.037055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 589/1179] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:50.312269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a235ff8-35e5-49e4-8a1c-fe753881c028 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:50.393412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:50.413236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a235ff8-35e5-49e4-8a1c-fe753881c028 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:50.446392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8239b-71a5-45b6-a7b0-84d744bcb938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:50.447051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8239b-71a5-45b6-a7b0-84d744bcb938 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:50.447333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8239b-71a5-45b6-a7b0-84d744bcb938 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:50.447603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8239b-71a5-45b6-a7b0-84d744bcb938 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:50.458175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8239b-71a5-45b6-a7b0-84d744bcb938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-d4f8239b-71a5-45b6-a7b0-84d744bcb938 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:50.462861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:50.464043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:50.466315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 591/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:50.472548 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5d516-8e39-4166-9850-85ca0b375d3b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:50.551528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:50.579108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5d516-8e39-4166-9850-85ca0b375d3b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:50.616959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2ddd4-7074-454f-b9c6-2cefc25b4ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:50.617571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2ddd4-7074-454f-b9c6-2cefc25b4ac2 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:50.620938 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2ddd4-7074-454f-b9c6-2cefc25b4ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:50.622279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2ddd4-7074-454f-b9c6-2cefc25b4ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:50.623007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2ddd4-7074-454f-b9c6-2cefc25b4ac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:50.623324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2ddd4-7074-454f-b9c6-2cefc25b4ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:50.624715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2ddd4-7074-454f-b9c6-2cefc25b4ac2 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:50.633104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 590/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:34:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:50.639830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8239b-71a5-45b6-a7b0-84d744bcb938 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:50.739642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8239b-71a5-45b6-a7b0-84d744bcb938 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:50.772959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371675-2c2c-4c71-a6af-2d60b2025272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:50.773577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371675-2c2c-4c71-a6af-2d60b2025272 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:50.773857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371675-2c2c-4c71-a6af-2d60b2025272 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:50.774131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371675-2c2c-4c71-a6af-2d60b2025272 None admin] PATH_INFO: `/v3/users/5b15ff433370453890d090fc492c69c6` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:50.785531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:50.788115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371675-2c2c-4c71-a6af-2d60b2025272 None admin] RBAC: Authorizing `identity:get_user(user_id=5b15ff433370453890d090fc492c69c6)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:50.789927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371675-2c2c-4c71-a6af-2d60b2025272 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:50.792006 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 592/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:50 2022] GET /identity/v3/users/5b15ff433370453890d090fc492c69c6 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:50.797860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2ddd4-7074-454f-b9c6-2cefc25b4ac2 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:50.900917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2ddd4-7074-454f-b9c6-2cefc25b4ac2 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:50.935603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10cffb-1385-458c-be99-910066f45ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:50.936208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10cffb-1385-458c-be99-910066f45ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:50.936489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10cffb-1385-458c-be99-910066f45ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:50.936764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10cffb-1385-458c-be99-910066f45ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:50.940377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:51.005103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10cffb-1385-458c-be99-910066f45ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:51.006542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10cffb-1385-458c-be99-910066f45ea8 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:51.107808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 591/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:51.113788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371675-2c2c-4c71-a6af-2d60b2025272 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:51.214837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371675-2c2c-4c71-a6af-2d60b2025272 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:51.249323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced195b1-5c5b-430d-baeb-09f38af51dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:51.249948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced195b1-5c5b-430d-baeb-09f38af51dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:51.250256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced195b1-5c5b-430d-baeb-09f38af51dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:51.250529 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced195b1-5c5b-430d-baeb-09f38af51dd5 None admin] PATH_INFO: `/v3/projects/35c18a01452846b0873d06b66d52c426` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:51.251672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced195b1-5c5b-430d-baeb-09f38af51dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=35c18a01452846b0873d06b66d52c426)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:51.253099 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced195b1-5c5b-430d-baeb-09f38af51dd5 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:51.254776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 593/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:51 2022] GET /identity/v3/projects/35c18a01452846b0873d06b66d52c426 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:51.262017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10cffb-1385-458c-be99-910066f45ea8 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:51.295525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:51.359767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10cffb-1385-458c-be99-910066f45ea8 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:51.394032 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c57ac-0792-4bf0-b57c-c4a535dca7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:51.394631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c57ac-0792-4bf0-b57c-c4a535dca7f7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:51.394943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c57ac-0792-4bf0-b57c-c4a535dca7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:51.395218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c57ac-0792-4bf0-b57c-c4a535dca7f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:51.395933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c57ac-0792-4bf0-b57c-c4a535dca7f7 None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=35c18a01452846b0873d06b66d52c426, user.id=5b15ff433370453890d090fc492c69c6) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:51.396239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c57ac-0792-4bf0-b57c-c4a535dca7f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:51.397656 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c57ac-0792-4bf0-b57c-c4a535dca7f7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:51.403616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 592/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:51 2022] GET /identity/v3/role_assignments?user.id=5b15ff433370453890d090fc492c69c6&scope.project.id=35c18a01452846b0873d06b66d52c426&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:53.287970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89daa77-9cac-418b-af48-bc9df587e0e1 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.288491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89daa77-9cac-418b-af48-bc9df587e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.288491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89daa77-9cac-418b-af48-bc9df587e0e1 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.289745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 594/1186] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:53.294978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772ada-d134-4d77-a392-4c11617edc14 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.295404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772ada-d134-4d77-a392-4c11617edc14 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.295538 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772ada-d134-4d77-a392-4c11617edc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.316715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-48772ada-d134-4d77-a392-4c11617edc14 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:53.317902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-48772ada-d134-4d77-a392-4c11617edc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:53.383164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 593/1187] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:53.648886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89daa77-9cac-418b-af48-bc9df587e0e1 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:53.715902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:53.750996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89daa77-9cac-418b-af48-bc9df587e0e1 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:53.783866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64beb3f-1241-42bc-837c-ddf2a084f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:53.784418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64beb3f-1241-42bc-837c-ddf2a084f24e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.784695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64beb3f-1241-42bc-837c-ddf2a084f24e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.784964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64beb3f-1241-42bc-837c-ddf2a084f24e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.795447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64beb3f-1241-42bc-837c-ddf2a084f24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-a64beb3f-1241-42bc-837c-ddf2a084f24e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:53.800100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:53.801180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:34:53.802209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 595/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:53.807452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772ada-d134-4d77-a392-4c11617edc14 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:53.837803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:53.910982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772ada-d134-4d77-a392-4c11617edc14 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:53.947520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7939-c767-4f0e-b24c-8e283ee30602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:53.948132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7939-c767-4f0e-b24c-8e283ee30602 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:53.948413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7939-c767-4f0e-b24c-8e283ee30602 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:53.948740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7939-c767-4f0e-b24c-8e283ee30602 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:53.950014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7939-c767-4f0e-b24c-8e283ee30602 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:53.950325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7939-c767-4f0e-b24c-8e283ee30602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:53.951724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7939-c767-4f0e-b24c-8e283ee30602 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:53.959894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 594/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:53.965923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64beb3f-1241-42bc-837c-ddf2a084f24e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:54.064197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64beb3f-1241-42bc-837c-ddf2a084f24e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:54.090148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:54.097932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d22ed5-7f6b-4f8b-8b68-535d3528b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:54.098549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d22ed5-7f6b-4f8b-8b68-535d3528b145 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.098850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d22ed5-7f6b-4f8b-8b68-535d3528b145 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.099121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d22ed5-7f6b-4f8b-8b68-535d3528b145 None admin] PATH_INFO: `/v3/users/5b15ff433370453890d090fc492c69c6` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.100234 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d22ed5-7f6b-4f8b-8b68-535d3528b145 None admin] RBAC: Authorizing `identity:get_user(user_id=5b15ff433370453890d090fc492c69c6)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.101654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d22ed5-7f6b-4f8b-8b68-535d3528b145 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:54.103251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 596/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:53 2022] GET /identity/v3/users/5b15ff433370453890d090fc492c69c6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:54.109187 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7939-c767-4f0e-b24c-8e283ee30602 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:54.201586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:54.210388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7939-c767-4f0e-b24c-8e283ee30602 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:54.243782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08af430-6d6b-452c-ac52-0e897c567632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:54.244404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08af430-6d6b-452c-ac52-0e897c567632 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.244685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08af430-6d6b-452c-ac52-0e897c567632 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.244956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08af430-6d6b-452c-ac52-0e897c567632 None admin] PATH_INFO: `/v3/projects/35c18a01452846b0873d06b66d52c426` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.246588 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08af430-6d6b-452c-ac52-0e897c567632 None admin] RBAC: Authorizing `identity:get_project(project_id=35c18a01452846b0873d06b66d52c426)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.248043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08af430-6d6b-452c-ac52-0e897c567632 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:54.249679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 595/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:54 2022] GET /identity/v3/projects/35c18a01452846b0873d06b66d52c426 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:54.255844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d22ed5-7f6b-4f8b-8b68-535d3528b145 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:54.353862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d22ed5-7f6b-4f8b-8b68-535d3528b145 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:54.388447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46192c09-a6f7-4b02-9904-1bcdb7a6b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:54.389099 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46192c09-a6f7-4b02-9904-1bcdb7a6b2ac None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:54.389378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46192c09-a6f7-4b02-9904-1bcdb7a6b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:54.389648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46192c09-a6f7-4b02-9904-1bcdb7a6b2ac None admin] PATH_INFO: `/v3/projects/35c18a01452846b0873d06b66d52c426/users/5b15ff433370453890d090fc492c69c6/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:54.391593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46192c09-a6f7-4b02-9904-1bcdb7a6b2ac None admin] RBAC: Authorizing `identity:create_grant(project_id=35c18a01452846b0873d06b66d52c426, user_id=5b15ff433370453890d090fc492c69c6, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:54.393021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46192c09-a6f7-4b02-9904-1bcdb7a6b2ac None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:54.406539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 597/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:34:54 2022] PUT /identity/v3/projects/35c18a01452846b0873d06b66d52c426/users/5b15ff433370453890d090fc492c69c6/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:34:56.291753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b61dc7-3eb5-4e4e-b217-4fbba141ce33 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:56.292252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b61dc7-3eb5-4e4e-b217-4fbba141ce33 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:56.292252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b61dc7-3eb5-4e4e-b217-4fbba141ce33 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:56.293613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 596/1193] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:34:56.298961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623fe79-e9c4-4d36-8f48-3ca2ada31b93 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:56.299377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623fe79-e9c4-4d36-8f48-3ca2ada31b93 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:56.299504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623fe79-e9c4-4d36-8f48-3ca2ada31b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:56.317506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-2623fe79-e9c4-4d36-8f48-3ca2ada31b93 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:34:56.318682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2623fe79-e9c4-4d36-8f48-3ca2ada31b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:34:56.369364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:56.388039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 598/1194] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:34:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:34:56.653262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b61dc7-3eb5-4e4e-b217-4fbba141ce33 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:56.757742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b61dc7-3eb5-4e4e-b217-4fbba141ce33 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:56.790427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8277ce9-37c9-402b-a0f4-894365a895b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:56.791067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8277ce9-37c9-402b-a0f4-894365a895b5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:56.791342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8277ce9-37c9-402b-a0f4-894365a895b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:56.791609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8277ce9-37c9-402b-a0f4-894365a895b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:56.802524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8277ce9-37c9-402b-a0f4-894365a895b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-b8277ce9-37c9-402b-a0f4-894365a895b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:34:56.807138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:34:56.809313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:34:56.810210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 597/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:34:56.814912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623fe79-e9c4-4d36-8f48-3ca2ada31b93 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:56.913382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623fe79-e9c4-4d36-8f48-3ca2ada31b93 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:56.947566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320098f1-cbe1-4e22-b351-42a026fecf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:56.948179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320098f1-cbe1-4e22-b351-42a026fecf24 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:56.948458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320098f1-cbe1-4e22-b351-42a026fecf24 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:56.948783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320098f1-cbe1-4e22-b351-42a026fecf24 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:56.949446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320098f1-cbe1-4e22-b351-42a026fecf24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:56.949747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320098f1-cbe1-4e22-b351-42a026fecf24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:56.951146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320098f1-cbe1-4e22-b351-42a026fecf24 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:56.959172 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 599/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:56.965559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8277ce9-37c9-402b-a0f4-894365a895b5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:56.988333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:57.065988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8277ce9-37c9-402b-a0f4-894365a895b5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:57.099207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058540d-5023-4d4f-a08e-dedaf60d0ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:57.099826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058540d-5023-4d4f-a08e-dedaf60d0ae0 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:57.100106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058540d-5023-4d4f-a08e-dedaf60d0ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:57.100382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058540d-5023-4d4f-a08e-dedaf60d0ae0 None admin] PATH_INFO: `/v3/users/5b15ff433370453890d090fc492c69c6` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:57.101505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058540d-5023-4d4f-a08e-dedaf60d0ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=5b15ff433370453890d090fc492c69c6)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:57.102965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058540d-5023-4d4f-a08e-dedaf60d0ae0 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:57.104551 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 598/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 11:34:56 2022] GET /identity/v3/users/5b15ff433370453890d090fc492c69c6 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:57.111617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320098f1-cbe1-4e22-b351-42a026fecf24 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:57.160601 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:57.210345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320098f1-cbe1-4e22-b351-42a026fecf24 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:57.243302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86da42-cf68-43f2-b879-21cdcdf01570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:57.243895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86da42-cf68-43f2-b879-21cdcdf01570 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:57.244170 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86da42-cf68-43f2-b879-21cdcdf01570 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:57.244437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86da42-cf68-43f2-b879-21cdcdf01570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:57.309740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86da42-cf68-43f2-b879-21cdcdf01570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:57.311218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86da42-cf68-43f2-b879-21cdcdf01570 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:57.357585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:57.407794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 600/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:34:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:57.413807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058540d-5023-4d4f-a08e-dedaf60d0ae0 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:57.503491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:57.516575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058540d-5023-4d4f-a08e-dedaf60d0ae0 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:57.550649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8957ea-f0ff-4892-8024-73f4bc1e459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:57.551301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8957ea-f0ff-4892-8024-73f4bc1e459b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:57.551580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8957ea-f0ff-4892-8024-73f4bc1e459b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:57.551852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8957ea-f0ff-4892-8024-73f4bc1e459b None admin] PATH_INFO: `/v3/projects/35c18a01452846b0873d06b66d52c426` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:57.552964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8957ea-f0ff-4892-8024-73f4bc1e459b None admin] RBAC: Authorizing `identity:get_project(project_id=35c18a01452846b0873d06b66d52c426)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:57.554389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8957ea-f0ff-4892-8024-73f4bc1e459b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:57.556051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 599/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 11:34:57 2022] GET /identity/v3/projects/35c18a01452846b0873d06b66d52c426 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:34:57.562484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86da42-cf68-43f2-b879-21cdcdf01570 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:34:57.659965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86da42-cf68-43f2-b879-21cdcdf01570 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:34:57.694584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd931b4-fa4f-4f66-a146-29542bf79eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:34:57.695208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd931b4-fa4f-4f66-a146-29542bf79eee None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:34:57.695485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd931b4-fa4f-4f66-a146-29542bf79eee None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:34:57.695751 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd931b4-fa4f-4f66-a146-29542bf79eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:34:57.696457 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd931b4-fa4f-4f66-a146-29542bf79eee None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=35c18a01452846b0873d06b66d52c426, user.id=5b15ff433370453890d090fc492c69c6) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:34:57.696759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd931b4-fa4f-4f66-a146-29542bf79eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:34:57.698167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd931b4-fa4f-4f66-a146-29542bf79eee None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:34:57.704492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 601/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:34:57 2022] GET /identity/v3/role_assignments?user.id=5b15ff433370453890d090fc492c69c6&scope.project.id=35c18a01452846b0873d06b66d52c426&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:35:07.546401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=22 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:07.701948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=94 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:54.068604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f7dfc-50b8-4084-858b-76171c2ebd78 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:54.069179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f7dfc-50b8-4084-858b-76171c2ebd78 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:54.069179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f7dfc-50b8-4084-858b-76171c2ebd78 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:54.070967 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 600/1201] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:35:54.078073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72cf59-7973-460a-8869-bd52a69826dd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:54.078073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72cf59-7973-460a-8869-bd52a69826dd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:54.078073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72cf59-7973-460a-8869-bd52a69826dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:54.097871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ac72cf59-7973-460a-8869-bd52a69826dd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:54.099208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ac72cf59-7973-460a-8869-bd52a69826dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:54.192763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 602/1202] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:35:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 11:35:54.468497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f7dfc-50b8-4084-858b-76171c2ebd78 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:54.601291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f7dfc-50b8-4084-858b-76171c2ebd78 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:54.654405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6df05c-0950-4e4b-bb8d-e34631a59149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:54.655191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6df05c-0950-4e4b-bb8d-e34631a59149 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:54.655536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6df05c-0950-4e4b-bb8d-e34631a59149 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:54.655886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6df05c-0950-4e4b-bb8d-e34631a59149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:54.670017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6df05c-0950-4e4b-bb8d-e34631a59149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:54.671573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6df05c-0950-4e4b-bb8d-e34631a59149 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-8e6df05c-0950-4e4b-bb8d-e34631a59149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:35:54.689674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:35:54.691274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:35:54.692561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:35:54.692561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:35:54.692561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:35:54.694350 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 601/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:35:54.701551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72cf59-7973-460a-8869-bd52a69826dd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:54.837419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72cf59-7973-460a-8869-bd52a69826dd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:54.887824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:54.896324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2e0b-5635-451e-8c91-edd6fb59d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:54.896993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2e0b-5635-451e-8c91-edd6fb59d6de None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:54.897282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2e0b-5635-451e-8c91-edd6fb59d6de None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:54.897558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2e0b-5635-451e-8c91-edd6fb59d6de None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:54.898355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb2e0b-5635-451e-8c91-edd6fb59d6de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:54.898803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb2e0b-5635-451e-8c91-edd6fb59d6de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:54.900477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb2e0b-5635-451e-8c91-edd6fb59d6de None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:54.913704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 603/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:35:54.920652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6df05c-0950-4e4b-bb8d-e34631a59149 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:54.991356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:55.049800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6df05c-0950-4e4b-bb8d-e34631a59149 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:55.106097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779ca0b-8759-492f-b5ab-b8f0a0a3c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:55.106753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779ca0b-8759-492f-b5ab-b8f0a0a3c785 None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:55.107139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779ca0b-8759-492f-b5ab-b8f0a0a3c785 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:55.107485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779ca0b-8759-492f-b5ab-b8f0a0a3c785 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:55.108459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779ca0b-8759-492f-b5ab-b8f0a0a3c785 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:55.110497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779ca0b-8759-492f-b5ab-b8f0a0a3c785 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:55.142430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 602/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 11:35:54 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:35:57.302092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58ceca-1546-4e81-a523-3931f1db5254 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:57.302625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58ceca-1546-4e81-a523-3931f1db5254 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:57.302625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58ceca-1546-4e81-a523-3931f1db5254 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:57.303874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 604/1206] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:35:57.310456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18317d03-4609-4a19-9565-008ac03e2915 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:57.310970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18317d03-4609-4a19-9565-008ac03e2915 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:57.311071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18317d03-4609-4a19-9565-008ac03e2915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:57.331152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-18317d03-4609-4a19-9565-008ac03e2915 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:35:57.332462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-18317d03-4609-4a19-9565-008ac03e2915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:35:57.412544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 603/1207] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:35:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:35:57.683769 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58ceca-1546-4e81-a523-3931f1db5254 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:57.815148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58ceca-1546-4e81-a523-3931f1db5254 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:57.856014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dc3d0-833d-4f05-8d68-2325dc673538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:57.856653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dc3d0-833d-4f05-8d68-2325dc673538 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:57.856933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dc3d0-833d-4f05-8d68-2325dc673538 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:57.857213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dc3d0-833d-4f05-8d68-2325dc673538 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:57.878253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80dc3d0-833d-4f05-8d68-2325dc673538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-e80dc3d0-833d-4f05-8d68-2325dc673538 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:35:57.884261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:35:57.885420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:35:57.886267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 605/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:35:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:35:57.891776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18317d03-4609-4a19-9565-008ac03e2915 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:57.936367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:58.005402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18317d03-4609-4a19-9565-008ac03e2915 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:58.043656 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40da0c-e046-4aa6-9f55-778be77e548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:58.044306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40da0c-e046-4aa6-9f55-778be77e548f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:58.044670 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40da0c-e046-4aa6-9f55-778be77e548f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:58.044915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40da0c-e046-4aa6-9f55-778be77e548f None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:58.045619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40da0c-e046-4aa6-9f55-778be77e548f None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:58.045921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40da0c-e046-4aa6-9f55-778be77e548f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:58.047553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40da0c-e046-4aa6-9f55-778be77e548f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:58.059423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 604/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:35:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:35:58.065317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dc3d0-833d-4f05-8d68-2325dc673538 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:58.127907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:58.200474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dc3d0-833d-4f05-8d68-2325dc673538 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:58.251129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a161f-6837-4cbb-a723-796872e021ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:58.251770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a161f-6837-4cbb-a723-796872e021ef None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:58.252039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a161f-6837-4cbb-a723-796872e021ef None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:58.252308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a161f-6837-4cbb-a723-796872e021ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:58.265977 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a161f-6837-4cbb-a723-796872e021ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:58.267465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a161f-6837-4cbb-a723-796872e021ef None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-d96a161f-6837-4cbb-a723-796872e021ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:35:58.288213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:35:58.289592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:35:58.290668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:35:58.290668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:35:58.290668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:35:58.290668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 606/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:35:58.294181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40da0c-e046-4aa6-9f55-778be77e548f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:58.416108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:58.419832 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40da0c-e046-4aa6-9f55-778be77e548f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:58.470982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc855dd-cb6d-4ccd-b59a-8414f469f10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:58.471530 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc855dd-cb6d-4ccd-b59a-8414f469f10f None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:58.471812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc855dd-cb6d-4ccd-b59a-8414f469f10f None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:58.472088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc855dd-cb6d-4ccd-b59a-8414f469f10f None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:58.472744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc855dd-cb6d-4ccd-b59a-8414f469f10f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:58.473052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc855dd-cb6d-4ccd-b59a-8414f469f10f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:58.474432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc855dd-cb6d-4ccd-b59a-8414f469f10f None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:58.491396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 605/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:35:58.497626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a161f-6837-4cbb-a723-796872e021ef None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:58.621340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a161f-6837-4cbb-a723-796872e021ef None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:58.623054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:58.662323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa77e2-a051-4014-808a-1147547566e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:58.663268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa77e2-a051-4014-808a-1147547566e5 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:58.663861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa77e2-a051-4014-808a-1147547566e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:58.664796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa77e2-a051-4014-808a-1147547566e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:58.675185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa77e2-a051-4014-808a-1147547566e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:58.676886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa77e2-a051-4014-808a-1147547566e5 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-8caa77e2-a051-4014-808a-1147547566e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:35:58.690095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:35:58.691153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:35:58.692103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 607/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:35:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:35:58.699168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc855dd-cb6d-4ccd-b59a-8414f469f10f None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:58.845286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc855dd-cb6d-4ccd-b59a-8414f469f10f None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:58.889347 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975111b1-3680-4243-9600-6862eae5ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:58.890398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975111b1-3680-4243-9600-6862eae5ca77 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:58.890893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975111b1-3680-4243-9600-6862eae5ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:58.891456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975111b1-3680-4243-9600-6862eae5ca77 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:58.892423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975111b1-3680-4243-9600-6862eae5ca77 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:58.892917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975111b1-3680-4243-9600-6862eae5ca77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:58.894716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975111b1-3680-4243-9600-6862eae5ca77 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:58.921123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 606/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 11:35:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:35:58.927060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa77e2-a051-4014-808a-1147547566e5 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:59.043831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa77e2-a051-4014-808a-1147547566e5 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:59.085507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5970327-c4c2-43a3-8a2b-d6002eb9c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:59.089273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5970327-c4c2-43a3-8a2b-d6002eb9c0ce None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:59.089273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5970327-c4c2-43a3-8a2b-d6002eb9c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:59.089273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5970327-c4c2-43a3-8a2b-d6002eb9c0ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:59.126912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:59.175194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5970327-c4c2-43a3-8a2b-d6002eb9c0ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:59.176929 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5970327-c4c2-43a3-8a2b-d6002eb9c0ce None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:59.309683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 608/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:35:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:35:59.315276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975111b1-3680-4243-9600-6862eae5ca77 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:59.338100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:59.441928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975111b1-3680-4243-9600-6862eae5ca77 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:59.483245 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be3e54-1d4f-4d01-9209-3f287ed13f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:59.484027 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be3e54-1d4f-4d01-9209-3f287ed13f87 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:59.484349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be3e54-1d4f-4d01-9209-3f287ed13f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:59.484623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be3e54-1d4f-4d01-9209-3f287ed13f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:59.498139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be3e54-1d4f-4d01-9209-3f287ed13f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:59.499740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be3e54-1d4f-4d01-9209-3f287ed13f87 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-77be3e54-1d4f-4d01-9209-3f287ed13f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:35:59.518693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:35:59.519792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:35:59.527710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:35:59.527710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:35:59.527710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:35:59.527710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 607/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:35:59.527981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5970327-c4c2-43a3-8a2b-d6002eb9c0ce None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:59.601700 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:59.658071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5970327-c4c2-43a3-8a2b-d6002eb9c0ce None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:59.700221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49608796-e385-4070-89e0-637d30440e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:59.700719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49608796-e385-4070-89e0-637d30440e6d None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:59.700995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49608796-e385-4070-89e0-637d30440e6d None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:59.701265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49608796-e385-4070-89e0-637d30440e6d None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:59.701945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49608796-e385-4070-89e0-637d30440e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:35:59.702249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49608796-e385-4070-89e0-637d30440e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:59.703682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49608796-e385-4070-89e0-637d30440e6d None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:59.717284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 609/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:35:59.723986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be3e54-1d4f-4d01-9209-3f287ed13f87 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:35:59.810647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:59.852031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be3e54-1d4f-4d01-9209-3f287ed13f87 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:35:59.899275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1cb4f-833f-4558-b610-29b01018cb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:35:59.900029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1cb4f-833f-4558-b610-29b01018cb5d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:35:59.900338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1cb4f-833f-4558-b610-29b01018cb5d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:35:59.900681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1cb4f-833f-4558-b610-29b01018cb5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:35:59.909869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1cb4f-833f-4558-b610-29b01018cb5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:35:59.911602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1cb4f-833f-4558-b610-29b01018cb5d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-0ce1cb4f-833f-4558-b610-29b01018cb5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:35:59.928760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:35:59.930761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:35:59.935771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:35:59.935771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:35:59.935771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:35:59.935771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:35:59.935771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:35:59.935771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:35:59.935771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:35:59.935771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:35:59.935771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 608/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:35:59.936297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49608796-e385-4070-89e0-637d30440e6d None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:00.076233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49608796-e385-4070-89e0-637d30440e6d None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:00.106606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:00.122179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8eba9c-71b1-4a95-8ced-d6f35d473391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:00.122820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8eba9c-71b1-4a95-8ced-d6f35d473391 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:00.123112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8eba9c-71b1-4a95-8ced-d6f35d473391 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:00.123386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8eba9c-71b1-4a95-8ced-d6f35d473391 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:00.124117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8eba9c-71b1-4a95-8ced-d6f35d473391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:00.124426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8eba9c-71b1-4a95-8ced-d6f35d473391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:00.125860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8eba9c-71b1-4a95-8ced-d6f35d473391 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:00.142613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 610/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:00.151259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1cb4f-833f-4558-b610-29b01018cb5d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:00.317840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1cb4f-833f-4558-b610-29b01018cb5d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:00.350597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:00.360048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b563d9-c186-4bfe-ba7e-e8d205d30380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:00.360823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b563d9-c186-4bfe-ba7e-e8d205d30380 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:00.361182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b563d9-c186-4bfe-ba7e-e8d205d30380 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:00.361583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b563d9-c186-4bfe-ba7e-e8d205d30380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:00.362505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b563d9-c186-4bfe-ba7e-e8d205d30380 None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=1485acc3d3e649168b8a1c69d0bbf12f) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:00.362930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b563d9-c186-4bfe-ba7e-e8d205d30380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:00.364603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b563d9-c186-4bfe-ba7e-e8d205d30380 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:00.372851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 609/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:36:00 2022] GET /identity/v3/role_assignments?user.id=1485acc3d3e649168b8a1c69d0bbf12f&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:02.473297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43950f8-2708-4fca-a83d-d5abd90d9bf2 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:02.473880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43950f8-2708-4fca-a83d-d5abd90d9bf2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:02.474030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43950f8-2708-4fca-a83d-d5abd90d9bf2 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:02.475405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 611/1220] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:36:02.481123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36030ed4-e895-4477-baa2-689571318be1 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:02.481586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36030ed4-e895-4477-baa2-689571318be1 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:02.481687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36030ed4-e895-4477-baa2-689571318be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:02.502911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-36030ed4-e895-4477-baa2-689571318be1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:02.504144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-36030ed4-e895-4477-baa2-689571318be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:02.586356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 610/1221] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:36:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:36:02.906189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43950f8-2708-4fca-a83d-d5abd90d9bf2 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:03.027338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43950f8-2708-4fca-a83d-d5abd90d9bf2 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:03.064059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45f29-8dbf-4895-aeeb-0cf05146bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:03.064692 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45f29-8dbf-4895-aeeb-0cf05146bd31 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:03.064974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45f29-8dbf-4895-aeeb-0cf05146bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:03.065248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45f29-8dbf-4895-aeeb-0cf05146bd31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:03.076641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea45f29-8dbf-4895-aeeb-0cf05146bd31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-6ea45f29-8dbf-4895-aeeb-0cf05146bd31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:36:03.081355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:03.082704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:03.083918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 612/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:03.089075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36030ed4-e895-4477-baa2-689571318be1 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:03.205677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36030ed4-e895-4477-baa2-689571318be1 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:03.234211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:03.248381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e612346-f764-4eb7-b06e-403806a151c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:03.249029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e612346-f764-4eb7-b06e-403806a151c7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:03.249298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e612346-f764-4eb7-b06e-403806a151c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:03.249576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e612346-f764-4eb7-b06e-403806a151c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:03.250310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e612346-f764-4eb7-b06e-403806a151c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:03.250582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e612346-f764-4eb7-b06e-403806a151c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:03.252110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e612346-f764-4eb7-b06e-403806a151c7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:03.262124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 611/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:03.268445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45f29-8dbf-4895-aeeb-0cf05146bd31 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:03.317353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:03.380197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45f29-8dbf-4895-aeeb-0cf05146bd31 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:03.418574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baceb7b-9435-44eb-9110-9e05394cefd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:03.419250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baceb7b-9435-44eb-9110-9e05394cefd6 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:03.419509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baceb7b-9435-44eb-9110-9e05394cefd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:03.419779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baceb7b-9435-44eb-9110-9e05394cefd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:03.430424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baceb7b-9435-44eb-9110-9e05394cefd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:03.431908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baceb7b-9435-44eb-9110-9e05394cefd6 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-0baceb7b-9435-44eb-9110-9e05394cefd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:03.446981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:03.448132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:03.449036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:03.449036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:03.449036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:03.449036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 613/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:03.454114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e612346-f764-4eb7-b06e-403806a151c7 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:03.560201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e612346-f764-4eb7-b06e-403806a151c7 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:03.601862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a76e1-b129-4965-8858-bd0ea2075331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:03.602606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a76e1-b129-4965-8858-bd0ea2075331 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:03.602933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a76e1-b129-4965-8858-bd0ea2075331 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:03.603863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a76e1-b129-4965-8858-bd0ea2075331 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:03.603994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a76e1-b129-4965-8858-bd0ea2075331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:03.604335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a76e1-b129-4965-8858-bd0ea2075331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:03.605920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a76e1-b129-4965-8858-bd0ea2075331 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:03.621108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 612/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:03.627290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baceb7b-9435-44eb-9110-9e05394cefd6 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:03.735119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:03.743610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baceb7b-9435-44eb-9110-9e05394cefd6 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:03.782095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795198-a0ae-4f5a-881c-d35a69c5846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:03.782722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795198-a0ae-4f5a-881c-d35a69c5846e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:03.783027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795198-a0ae-4f5a-881c-d35a69c5846e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:03.783301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795198-a0ae-4f5a-881c-d35a69c5846e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:03.792167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8795198-a0ae-4f5a-881c-d35a69c5846e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:03.793711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8795198-a0ae-4f5a-881c-d35a69c5846e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-d8795198-a0ae-4f5a-881c-d35a69c5846e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:36:03.805912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:03.807111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:03.808265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 614/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:03.813261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a76e1-b129-4965-8858-bd0ea2075331 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:03.865466 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:03.935476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a76e1-b129-4965-8858-bd0ea2075331 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:03.980373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cf8c1-1990-49fc-913c-84d8b9754211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:03.981065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cf8c1-1990-49fc-913c-84d8b9754211 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:03.981348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cf8c1-1990-49fc-913c-84d8b9754211 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:03.981782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cf8c1-1990-49fc-913c-84d8b9754211 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:03.982660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cf8c1-1990-49fc-913c-84d8b9754211 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:03.982999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cf8c1-1990-49fc-913c-84d8b9754211 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:03.984901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cf8c1-1990-49fc-913c-84d8b9754211 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:04.010993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 613/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 11:36:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:04.014076 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795198-a0ae-4f5a-881c-d35a69c5846e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:04.135677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795198-a0ae-4f5a-881c-d35a69c5846e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:04.175798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad96ce-f2ed-46db-8600-433a4900cdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:04.176501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad96ce-f2ed-46db-8600-433a4900cdd0 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:04.176821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad96ce-f2ed-46db-8600-433a4900cdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:04.177134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad96ce-f2ed-46db-8600-433a4900cdd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:04.190513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad96ce-f2ed-46db-8600-433a4900cdd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:04.191991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad96ce-f2ed-46db-8600-433a4900cdd0 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-adad96ce-f2ed-46db-8600-433a4900cdd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:04.209265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:04.210578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:04.211817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:04.211817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:04.211817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:04.214894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 615/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:04.218033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cf8c1-1990-49fc-913c-84d8b9754211 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:04.341440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cf8c1-1990-49fc-913c-84d8b9754211 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:04.343841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:04.381016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684ef7a-be37-4af9-9b72-3c8c7c2e0997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:04.381635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684ef7a-be37-4af9-9b72-3c8c7c2e0997 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:04.381968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684ef7a-be37-4af9-9b72-3c8c7c2e0997 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:04.382802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684ef7a-be37-4af9-9b72-3c8c7c2e0997 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:04.383735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684ef7a-be37-4af9-9b72-3c8c7c2e0997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:04.384038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684ef7a-be37-4af9-9b72-3c8c7c2e0997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:04.385614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684ef7a-be37-4af9-9b72-3c8c7c2e0997 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:04.397526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 614/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:04.404292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad96ce-f2ed-46db-8600-433a4900cdd0 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:04.414847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:04.517382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad96ce-f2ed-46db-8600-433a4900cdd0 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:04.555737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a74ee-161c-46ad-bbf8-01641b11efd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:04.556377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a74ee-161c-46ad-bbf8-01641b11efd2 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:04.556656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a74ee-161c-46ad-bbf8-01641b11efd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:04.556927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a74ee-161c-46ad-bbf8-01641b11efd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:04.563747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a74ee-161c-46ad-bbf8-01641b11efd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:04.565180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a74ee-161c-46ad-bbf8-01641b11efd2 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-166a74ee-161c-46ad-bbf8-01641b11efd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:36:04.577026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:04.578239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:04.579380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:36:04.579380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:36:04.579380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:36:04.579380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:36:04.579380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:36:04.579380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:36:04.579380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:04.579380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:04.584873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 616/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:36:04.585025 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684ef7a-be37-4af9-9b72-3c8c7c2e0997 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:04.696780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684ef7a-be37-4af9-9b72-3c8c7c2e0997 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:04.735732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78f82-6ede-4ff0-a849-3905c364eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:04.736399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78f82-6ede-4ff0-a849-3905c364eec9 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:04.736736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78f82-6ede-4ff0-a849-3905c364eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:04.736961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78f82-6ede-4ff0-a849-3905c364eec9 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:04.737839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a78f82-6ede-4ff0-a849-3905c364eec9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:04.738106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a78f82-6ede-4ff0-a849-3905c364eec9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:04.739693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a78f82-6ede-4ff0-a849-3905c364eec9 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:04.753393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 615/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:04.760938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a74ee-161c-46ad-bbf8-01641b11efd2 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:04.839321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:04.879271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a74ee-161c-46ad-bbf8-01641b11efd2 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:04.917919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a375e7-59e8-40cb-b431-c0285eb8de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:04.918570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a375e7-59e8-40cb-b431-c0285eb8de77 None admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:04.918881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a375e7-59e8-40cb-b431-c0285eb8de77 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:04.919154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a375e7-59e8-40cb-b431-c0285eb8de77 None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/1485acc3d3e649168b8a1c69d0bbf12f/roles/4631f2d361794b9e9e39f07bdc207d1e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:04.935651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a375e7-59e8-40cb-b431-c0285eb8de77 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=1485acc3d3e649168b8a1c69d0bbf12f, role_id=4631f2d361794b9e9e39f07bdc207d1e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:04.937429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a375e7-59e8-40cb-b431-c0285eb8de77 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:04.953864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 617/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:36:04 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/1485acc3d3e649168b8a1c69d0bbf12f/roles/4631f2d361794b9e9e39f07bdc207d1e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:36:07.011267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b43c8-4bff-412d-9783-85763f2f44fc None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:07.011821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b43c8-4bff-412d-9783-85763f2f44fc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:07.011821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b43c8-4bff-412d-9783-85763f2f44fc None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:07.013159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 616/1233] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:36:07.019719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7a1e9-4856-428a-ab0c-002cc105a19f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:07.020155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7a1e9-4856-428a-ab0c-002cc105a19f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:07.020277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7a1e9-4856-428a-ab0c-002cc105a19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:07.040413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-a2b7a1e9-4856-428a-ab0c-002cc105a19f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:07.041621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a2b7a1e9-4856-428a-ab0c-002cc105a19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:07.112790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 618/1234] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:36:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:36:07.429806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b43c8-4bff-412d-9783-85763f2f44fc None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:07.463654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:07.553071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b43c8-4bff-412d-9783-85763f2f44fc None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:07.593142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01126233-8355-4474-bc53-76e985f019b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:07.593771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01126233-8355-4474-bc53-76e985f019b2 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:07.594048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01126233-8355-4474-bc53-76e985f019b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:07.594314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01126233-8355-4474-bc53-76e985f019b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:07.605799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01126233-8355-4474-bc53-76e985f019b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-01126233-8355-4474-bc53-76e985f019b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:36:07.610682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:07.611733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:07.612560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 617/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 11:36:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:07.618935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7a1e9-4856-428a-ab0c-002cc105a19f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:07.671638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:07.734021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7a1e9-4856-428a-ab0c-002cc105a19f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:07.771013 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c4fba-cfdc-4ee3-bb8d-d48afd3eddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:07.771750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4fba-cfdc-4ee3-bb8d-d48afd3eddb8 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:07.772038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4fba-cfdc-4ee3-bb8d-d48afd3eddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:07.772413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4fba-cfdc-4ee3-bb8d-d48afd3eddb8 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:07.773737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c4fba-cfdc-4ee3-bb8d-d48afd3eddb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:07.774099 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c4fba-cfdc-4ee3-bb8d-d48afd3eddb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:07.775615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c4fba-cfdc-4ee3-bb8d-d48afd3eddb8 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:07.784943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 619/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 11:36:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:07.791472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01126233-8355-4474-bc53-76e985f019b2 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:07.901821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:07.922138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01126233-8355-4474-bc53-76e985f019b2 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:07.965795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deea603-08b6-4f66-8cbf-485d8e947932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:07.966985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deea603-08b6-4f66-8cbf-485d8e947932 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:07.967269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deea603-08b6-4f66-8cbf-485d8e947932 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:07.967549 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deea603-08b6-4f66-8cbf-485d8e947932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:07.981869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deea603-08b6-4f66-8cbf-485d8e947932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:07.983583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deea603-08b6-4f66-8cbf-485d8e947932 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-0deea603-08b6-4f66-8cbf-485d8e947932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:08.003183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:08.004189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:08.005274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:08.005274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:08.005274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:08.005274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 618/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:08.012603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c4fba-cfdc-4ee3-bb8d-d48afd3eddb8 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:08.135757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c4fba-cfdc-4ee3-bb8d-d48afd3eddb8 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:08.144809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:08.176994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0627c5a-cb56-48ff-8e5a-047e613f16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:08.177696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0627c5a-cb56-48ff-8e5a-047e613f16be None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:08.178041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0627c5a-cb56-48ff-8e5a-047e613f16be None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:08.178374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0627c5a-cb56-48ff-8e5a-047e613f16be None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:08.179944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0627c5a-cb56-48ff-8e5a-047e613f16be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:08.180307 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0627c5a-cb56-48ff-8e5a-047e613f16be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:08.181701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0627c5a-cb56-48ff-8e5a-047e613f16be None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:08.194860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 620/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:36:08.200472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deea603-08b6-4f66-8cbf-485d8e947932 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:08.341107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deea603-08b6-4f66-8cbf-485d8e947932 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:08.386570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb550-4204-4628-8c77-8dd1b9ee3f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:08.387302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb550-4204-4628-8c77-8dd1b9ee3f76 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:08.387720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb550-4204-4628-8c77-8dd1b9ee3f76 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:08.388147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb550-4204-4628-8c77-8dd1b9ee3f76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:08.391932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:08.399824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb550-4204-4628-8c77-8dd1b9ee3f76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:08.401532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb550-4204-4628-8c77-8dd1b9ee3f76 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-c76bb550-4204-4628-8c77-8dd1b9ee3f76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:36:08.414823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:08.416068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:08.417240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 619/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:36:08.422602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0627c5a-cb56-48ff-8e5a-047e613f16be None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:08.549131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0627c5a-cb56-48ff-8e5a-047e613f16be None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:08.589771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b58c9-0f51-4a00-b144-d29b30d2575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:08.590428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b58c9-0f51-4a00-b144-d29b30d2575f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:08.590712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b58c9-0f51-4a00-b144-d29b30d2575f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:08.591086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b58c9-0f51-4a00-b144-d29b30d2575f None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:08.591799 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b58c9-0f51-4a00-b144-d29b30d2575f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:08.592109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b58c9-0f51-4a00-b144-d29b30d2575f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:08.593526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b58c9-0f51-4a00-b144-d29b30d2575f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:08.612185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 621/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 11:36:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:08.618695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb550-4204-4628-8c77-8dd1b9ee3f76 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:08.736689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb550-4204-4628-8c77-8dd1b9ee3f76 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:08.776416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34086b11-e08a-4ddd-a3f6-bd1acf5f8d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:08.777077 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34086b11-e08a-4ddd-a3f6-bd1acf5f8d02 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:08.777424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34086b11-e08a-4ddd-a3f6-bd1acf5f8d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:08.777795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34086b11-e08a-4ddd-a3f6-bd1acf5f8d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:08.853063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:08.861150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34086b11-e08a-4ddd-a3f6-bd1acf5f8d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:08.863138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34086b11-e08a-4ddd-a3f6-bd1acf5f8d02 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:08.997661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 620/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:36:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:36:08.998985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b58c9-0f51-4a00-b144-d29b30d2575f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:09.034324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:09.125353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b58c9-0f51-4a00-b144-d29b30d2575f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:09.162675 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0f4cb-995c-4c14-8561-b1b8ccf72177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:09.163854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0f4cb-995c-4c14-8561-b1b8ccf72177 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:09.164149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0f4cb-995c-4c14-8561-b1b8ccf72177 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:09.164423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0f4cb-995c-4c14-8561-b1b8ccf72177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:09.174605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0f4cb-995c-4c14-8561-b1b8ccf72177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:09.176087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0f4cb-995c-4c14-8561-b1b8ccf72177 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-8db0f4cb-995c-4c14-8561-b1b8ccf72177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:09.191740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:09.192840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:09.193725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:09.193725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:09.193725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:09.193725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 622/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:36:09.200133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34086b11-e08a-4ddd-a3f6-bd1acf5f8d02 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:09.317395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:09.324855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34086b11-e08a-4ddd-a3f6-bd1acf5f8d02 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:09.362992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3600df-7ed0-4805-9c05-4c93f4049f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:09.363608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3600df-7ed0-4805-9c05-4c93f4049f65 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:09.363889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3600df-7ed0-4805-9c05-4c93f4049f65 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:09.364164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3600df-7ed0-4805-9c05-4c93f4049f65 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:09.364830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3600df-7ed0-4805-9c05-4c93f4049f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:09.365106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3600df-7ed0-4805-9c05-4c93f4049f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:09.367745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3600df-7ed0-4805-9c05-4c93f4049f65 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:09.379972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 621/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:09.387041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0f4cb-995c-4c14-8561-b1b8ccf72177 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:09.473976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:09.499606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0f4cb-995c-4c14-8561-b1b8ccf72177 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:09.540775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfa486-b28c-4ea9-b8b9-9c5ec46c491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:09.541679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfa486-b28c-4ea9-b8b9-9c5ec46c491a None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:09.542209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfa486-b28c-4ea9-b8b9-9c5ec46c491a None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:09.542396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfa486-b28c-4ea9-b8b9-9c5ec46c491a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:09.550331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfa486-b28c-4ea9-b8b9-9c5ec46c491a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:09.551991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfa486-b28c-4ea9-b8b9-9c5ec46c491a None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-d9dfa486-b28c-4ea9-b8b9-9c5ec46c491a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:36:09.565825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:09.567045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:09.574820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:36:09.574820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:36:09.574820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:36:09.574820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:36:09.574820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:36:09.574820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:36:09.574820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:09.574820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:09.574820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 623/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:09.575433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3600df-7ed0-4805-9c05-4c93f4049f65 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:09.704785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3600df-7ed0-4805-9c05-4c93f4049f65 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:09.743780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923dc0e-800c-4adc-b893-f1c2239f4675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:09.744403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923dc0e-800c-4adc-b893-f1c2239f4675 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:09.744684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923dc0e-800c-4adc-b893-f1c2239f4675 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:09.744957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923dc0e-800c-4adc-b893-f1c2239f4675 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:09.745657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923dc0e-800c-4adc-b893-f1c2239f4675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:09.745962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923dc0e-800c-4adc-b893-f1c2239f4675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:09.747452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923dc0e-800c-4adc-b893-f1c2239f4675 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:09.763530 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 622/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:09.769535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfa486-b28c-4ea9-b8b9-9c5ec46c491a None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:09.886963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfa486-b28c-4ea9-b8b9-9c5ec46c491a None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:09.926295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73db6e-56b8-49ad-bdae-36e7efbed974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:09.927008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73db6e-56b8-49ad-bdae-36e7efbed974 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:09.927309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73db6e-56b8-49ad-bdae-36e7efbed974 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:09.927582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73db6e-56b8-49ad-bdae-36e7efbed974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:09.928372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73db6e-56b8-49ad-bdae-36e7efbed974 None admin] RBAC: Adding query filter params (role.id=4631f2d361794b9e9e39f07bdc207d1e, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=1485acc3d3e649168b8a1c69d0bbf12f) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:09.929231 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73db6e-56b8-49ad-bdae-36e7efbed974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:09.930660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73db6e-56b8-49ad-bdae-36e7efbed974 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:09.939947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 624/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:36:09 2022] GET /identity/v3/role_assignments?user.id=1485acc3d3e649168b8a1c69d0bbf12f&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=4631f2d361794b9e9e39f07bdc207d1e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:36:11.965570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add32fb-e56d-442a-98fe-a240160da95e None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:11.966227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add32fb-e56d-442a-98fe-a240160da95e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:11.966227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add32fb-e56d-442a-98fe-a240160da95e None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:11.967464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 623/1247] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:36:11.973479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a21f6-9c0c-4c4a-8307-35a2d8e63bf0 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:11.973954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a21f6-9c0c-4c4a-8307-35a2d8e63bf0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:11.974227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a21f6-9c0c-4c4a-8307-35a2d8e63bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:11.982145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:11.997014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-074a21f6-9c0c-4c4a-8307-35a2d8e63bf0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:11.998282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-074a21f6-9c0c-4c4a-8307-35a2d8e63bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:12.080495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 625/1248] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:36:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:36:12.410220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add32fb-e56d-442a-98fe-a240160da95e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:12.442349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:12.557303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add32fb-e56d-442a-98fe-a240160da95e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:12.607338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347826-5007-485b-be7c-acd7c78c6e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:12.608052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347826-5007-485b-be7c-acd7c78c6e61 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:12.608374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347826-5007-485b-be7c-acd7c78c6e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:12.608651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347826-5007-485b-be7c-acd7c78c6e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:12.623547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b347826-5007-485b-be7c-acd7c78c6e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-5b347826-5007-485b-be7c-acd7c78c6e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:36:12.628953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:12.630125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:36:12.631419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:12.635233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 624/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:36:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:12.638858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a21f6-9c0c-4c4a-8307-35a2d8e63bf0 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:12.773468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a21f6-9c0c-4c4a-8307-35a2d8e63bf0 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:12.809313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:12.816662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46482c3-fd5c-4ea7-85c7-f152c552254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:12.817717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46482c3-fd5c-4ea7-85c7-f152c552254b None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:12.818239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46482c3-fd5c-4ea7-85c7-f152c552254b None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:12.818693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46482c3-fd5c-4ea7-85c7-f152c552254b None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:12.820444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46482c3-fd5c-4ea7-85c7-f152c552254b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:12.820817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46482c3-fd5c-4ea7-85c7-f152c552254b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:12.822468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46482c3-fd5c-4ea7-85c7-f152c552254b None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:12.837075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 626/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:12.843999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347826-5007-485b-be7c-acd7c78c6e61 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:12.936561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:12.964481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347826-5007-485b-be7c-acd7c78c6e61 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:13.005495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faab58-c59a-4026-a7e7-e2d328f2132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:13.006406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faab58-c59a-4026-a7e7-e2d328f2132e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:13.006406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faab58-c59a-4026-a7e7-e2d328f2132e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:13.007437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faab58-c59a-4026-a7e7-e2d328f2132e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:13.018787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faab58-c59a-4026-a7e7-e2d328f2132e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:13.020591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faab58-c59a-4026-a7e7-e2d328f2132e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-88faab58-c59a-4026-a7e7-e2d328f2132e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:13.039417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:13.040615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:13.041738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:13.041738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:13.041738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:13.041738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 625/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 11:36:13.046585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46482c3-fd5c-4ea7-85c7-f152c552254b None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:13.162792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46482c3-fd5c-4ea7-85c7-f152c552254b None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:13.202090 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c2ed5-7b98-44e4-bb62-27e5b4270439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:13.202672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c2ed5-7b98-44e4-bb62-27e5b4270439 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:13.202980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c2ed5-7b98-44e4-bb62-27e5b4270439 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:13.203247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c2ed5-7b98-44e4-bb62-27e5b4270439 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:13.203887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c2ed5-7b98-44e4-bb62-27e5b4270439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:13.204182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c2ed5-7b98-44e4-bb62-27e5b4270439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:13.205530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c2ed5-7b98-44e4-bb62-27e5b4270439 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:13.220776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 627/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:13.227481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faab58-c59a-4026-a7e7-e2d328f2132e None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:13.345098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faab58-c59a-4026-a7e7-e2d328f2132e None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:13.375571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:13.385258 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef84328-97ed-41ee-b76f-06501a6cea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:13.385916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef84328-97ed-41ee-b76f-06501a6cea03 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:13.386214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef84328-97ed-41ee-b76f-06501a6cea03 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:13.386500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef84328-97ed-41ee-b76f-06501a6cea03 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:13.396609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef84328-97ed-41ee-b76f-06501a6cea03 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:13.398375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef84328-97ed-41ee-b76f-06501a6cea03 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-1ef84328-97ed-41ee-b76f-06501a6cea03 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:36:13.410895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:13.412214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:13.413659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 626/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:13.420512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c2ed5-7b98-44e4-bb62-27e5b4270439 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:13.485624 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:13.539924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c2ed5-7b98-44e4-bb62-27e5b4270439 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:13.581225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f006-fa5c-4d4a-9182-ac1d2dc9351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:13.581836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f006-fa5c-4d4a-9182-ac1d2dc9351f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:13.582117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f006-fa5c-4d4a-9182-ac1d2dc9351f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:13.582437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f006-fa5c-4d4a-9182-ac1d2dc9351f None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:13.583283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902f006-fa5c-4d4a-9182-ac1d2dc9351f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:13.583619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902f006-fa5c-4d4a-9182-ac1d2dc9351f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:13.585155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902f006-fa5c-4d4a-9182-ac1d2dc9351f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:13.605589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 628/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 11:36:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:13.611669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef84328-97ed-41ee-b76f-06501a6cea03 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:13.730005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef84328-97ed-41ee-b76f-06501a6cea03 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:13.766994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf5ec-d639-45a0-895d-2e57d35b5fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:13.767604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf5ec-d639-45a0-895d-2e57d35b5fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:13.767883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf5ec-d639-45a0-895d-2e57d35b5fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:13.768154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf5ec-d639-45a0-895d-2e57d35b5fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:13.826930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:13.840628 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf5ec-d639-45a0-895d-2e57d35b5fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:13.842157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf5ec-d639-45a0-895d-2e57d35b5fb1 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:13.966808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 627/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:36:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 11:36:13.972662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f006-fa5c-4d4a-9182-ac1d2dc9351f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:14.082325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f006-fa5c-4d4a-9182-ac1d2dc9351f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:14.097272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:14.122235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aee7ed-884f-4ad8-90b9-69fcf9eb05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:14.123296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee7ed-884f-4ad8-90b9-69fcf9eb05d5 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:14.123580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee7ed-884f-4ad8-90b9-69fcf9eb05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:14.124054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee7ed-884f-4ad8-90b9-69fcf9eb05d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:14.138513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aee7ed-884f-4ad8-90b9-69fcf9eb05d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:14.140010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aee7ed-884f-4ad8-90b9-69fcf9eb05d5 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-52aee7ed-884f-4ad8-90b9-69fcf9eb05d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:14.157616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:14.158705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:14.159619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:14.159619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:14.159619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:14.159619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 629/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:14.167232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf5ec-d639-45a0-895d-2e57d35b5fb1 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:14.286291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:14.299995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf5ec-d639-45a0-895d-2e57d35b5fb1 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:14.338385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1e52e-0eb9-4206-8a92-4e717fe1eeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:14.339036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e52e-0eb9-4206-8a92-4e717fe1eeff None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:14.339315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e52e-0eb9-4206-8a92-4e717fe1eeff None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:14.339580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e52e-0eb9-4206-8a92-4e717fe1eeff None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:14.340219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1e52e-0eb9-4206-8a92-4e717fe1eeff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:14.340543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1e52e-0eb9-4206-8a92-4e717fe1eeff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:14.342051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1e52e-0eb9-4206-8a92-4e717fe1eeff None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:14.354275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 628/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:14.360292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aee7ed-884f-4ad8-90b9-69fcf9eb05d5 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:14.475666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aee7ed-884f-4ad8-90b9-69fcf9eb05d5 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:14.516110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2809cc8-5074-4ce8-bf54-cac00091f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:14.516883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2809cc8-5074-4ce8-bf54-cac00091f110 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:14.517275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2809cc8-5074-4ce8-bf54-cac00091f110 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:14.517638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2809cc8-5074-4ce8-bf54-cac00091f110 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:14.525592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2809cc8-5074-4ce8-bf54-cac00091f110 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:14.527107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2809cc8-5074-4ce8-bf54-cac00091f110 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-e2809cc8-5074-4ce8-bf54-cac00091f110 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:36:14.539240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:14.540466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:14.541819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:36:14.541819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:36:14.541819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:36:14.541819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:36:14.541819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:36:14.541819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:36:14.541819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:14.541819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:14.541819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 630/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:14.546643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1e52e-0eb9-4206-8a92-4e717fe1eeff None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:14.661152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1e52e-0eb9-4206-8a92-4e717fe1eeff None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:14.705379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7c282-6de1-4e4f-aebd-65ee8418cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:14.705984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7c282-6de1-4e4f-aebd-65ee8418cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:14.706259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7c282-6de1-4e4f-aebd-65ee8418cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:14.706525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7c282-6de1-4e4f-aebd-65ee8418cfc6 None admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:14.707564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7c282-6de1-4e4f-aebd-65ee8418cfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:14.707903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7c282-6de1-4e4f-aebd-65ee8418cfc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:14.710177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7c282-6de1-4e4f-aebd-65ee8418cfc6 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:14.726638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 629/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:36:14.732660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2809cc8-5074-4ce8-bf54-cac00091f110 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:14.760532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:14.841360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2809cc8-5074-4ce8-bf54-cac00091f110 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:14.880680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff5bda-00dc-4ca5-8db6-070c428e5a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:14.881399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff5bda-00dc-4ca5-8db6-070c428e5a94 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:14.881978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff5bda-00dc-4ca5-8db6-070c428e5a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:14.882387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff5bda-00dc-4ca5-8db6-070c428e5a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:14.883495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff5bda-00dc-4ca5-8db6-070c428e5a94 None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=1485acc3d3e649168b8a1c69d0bbf12f) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:14.883881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff5bda-00dc-4ca5-8db6-070c428e5a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:14.885433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff5bda-00dc-4ca5-8db6-070c428e5a94 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:14.891942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 631/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:36:14 2022] GET /identity/v3/role_assignments?user.id=1485acc3d3e649168b8a1c69d0bbf12f&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:36:16.909661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8705-8a24-439c-9c49-ba3e64816d0b None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:16.910318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8705-8a24-439c-9c49-ba3e64816d0b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:16.910318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8705-8a24-439c-9c49-ba3e64816d0b None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:16.911575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 630/1261] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:36:16.917743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2a66b-d4d3-4aa6-8859-8abc265dd8ab None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:16.918263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2a66b-d4d3-4aa6-8859-8abc265dd8ab None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:16.918263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2a66b-d4d3-4aa6-8859-8abc265dd8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:16.937220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d9d2a66b-d4d3-4aa6-8859-8abc265dd8ab None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:16.938420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d9d2a66b-d4d3-4aa6-8859-8abc265dd8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:17.011142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 632/1262] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:36:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:36:17.281238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f8705-8a24-439c-9c49-ba3e64816d0b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:17.292881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:17.388200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f8705-8a24-439c-9c49-ba3e64816d0b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:17.422427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057f0b8-ba6d-457c-8b15-ed0a16e83153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:17.423074 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057f0b8-ba6d-457c-8b15-ed0a16e83153 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:17.423352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057f0b8-ba6d-457c-8b15-ed0a16e83153 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:17.423625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057f0b8-ba6d-457c-8b15-ed0a16e83153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:17.434080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057f0b8-ba6d-457c-8b15-ed0a16e83153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-9057f0b8-ba6d-457c-8b15-ed0a16e83153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:36:17.441607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:17.442855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:17.444368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 631/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:36:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:17.449996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2a66b-d4d3-4aa6-8859-8abc265dd8ab None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:17.476342 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:17.560096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2a66b-d4d3-4aa6-8859-8abc265dd8ab None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:17.597086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54899db-dfd4-4d40-9a17-6fa5aabc7b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:17.597687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54899db-dfd4-4d40-9a17-6fa5aabc7b17 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:17.597967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54899db-dfd4-4d40-9a17-6fa5aabc7b17 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:17.598237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54899db-dfd4-4d40-9a17-6fa5aabc7b17 None admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:17.598926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54899db-dfd4-4d40-9a17-6fa5aabc7b17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:17.599233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54899db-dfd4-4d40-9a17-6fa5aabc7b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:17.601292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54899db-dfd4-4d40-9a17-6fa5aabc7b17 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:17.609536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 633/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:36:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:17.615484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057f0b8-ba6d-457c-8b15-ed0a16e83153 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:17.688133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:17.721696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057f0b8-ba6d-457c-8b15-ed0a16e83153 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:17.758646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca6859-deb0-434b-926d-11c45aeeadd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:17.759285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca6859-deb0-434b-926d-11c45aeeadd0 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:17.759558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca6859-deb0-434b-926d-11c45aeeadd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:17.759826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca6859-deb0-434b-926d-11c45aeeadd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:17.772065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca6859-deb0-434b-926d-11c45aeeadd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:17.773792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca6859-deb0-434b-926d-11c45aeeadd0 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-37ca6859-deb0-434b-926d-11c45aeeadd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:17.793273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:17.795259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:17.796907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:17.796907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:17.796907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:17.796907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 632/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:17.803814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54899db-dfd4-4d40-9a17-6fa5aabc7b17 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:17.903986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:17.926811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54899db-dfd4-4d40-9a17-6fa5aabc7b17 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:17.969382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ac39c-ed8b-47cd-a595-8f4cd6b42597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:17.969995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ac39c-ed8b-47cd-a595-8f4cd6b42597 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:17.970275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ac39c-ed8b-47cd-a595-8f4cd6b42597 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:17.970551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ac39c-ed8b-47cd-a595-8f4cd6b42597 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:17.971234 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ac39c-ed8b-47cd-a595-8f4cd6b42597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:17.971539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ac39c-ed8b-47cd-a595-8f4cd6b42597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:17.972896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ac39c-ed8b-47cd-a595-8f4cd6b42597 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:17.986952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 634/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:17.996322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca6859-deb0-434b-926d-11c45aeeadd0 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:18.128496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca6859-deb0-434b-926d-11c45aeeadd0 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:18.150583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:18.168070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3639b7-84b0-4101-97d9-758aed25ef97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:18.168627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3639b7-84b0-4101-97d9-758aed25ef97 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:18.168910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3639b7-84b0-4101-97d9-758aed25ef97 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:18.169185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3639b7-84b0-4101-97d9-758aed25ef97 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:18.177043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3639b7-84b0-4101-97d9-758aed25ef97 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:18.179513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3639b7-84b0-4101-97d9-758aed25ef97 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-3f3639b7-84b0-4101-97d9-758aed25ef97 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:36:18.191987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:18.193218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:18.194565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 633/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:18.199406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ac39c-ed8b-47cd-a595-8f4cd6b42597 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:18.331121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ac39c-ed8b-47cd-a595-8f4cd6b42597 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:18.369686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08949c0-2836-449f-a76f-215d9948c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:18.370299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08949c0-2836-449f-a76f-215d9948c0fa None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:18.370579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08949c0-2836-449f-a76f-215d9948c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:18.370883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08949c0-2836-449f-a76f-215d9948c0fa None admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:18.371617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08949c0-2836-449f-a76f-215d9948c0fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:18.371924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08949c0-2836-449f-a76f-215d9948c0fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:18.373351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08949c0-2836-449f-a76f-215d9948c0fa None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:18.384060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:18.394264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 635/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 11:36:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:18.400651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3639b7-84b0-4101-97d9-758aed25ef97 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:18.521665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3639b7-84b0-4101-97d9-758aed25ef97 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:18.555731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94550a86-72cd-43b8-b325-0276b072ebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:18.556358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94550a86-72cd-43b8-b325-0276b072ebe5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:18.556642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94550a86-72cd-43b8-b325-0276b072ebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:18.556917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94550a86-72cd-43b8-b325-0276b072ebe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:18.567522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94550a86-72cd-43b8-b325-0276b072ebe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:18.569117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94550a86-72cd-43b8-b325-0276b072ebe5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-94550a86-72cd-43b8-b325-0276b072ebe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:18.583145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:18.584284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:18.586178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:18.586178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:18.586178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:18.586178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 634/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:18.590693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08949c0-2836-449f-a76f-215d9948c0fa None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:18.690611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08949c0-2836-449f-a76f-215d9948c0fa None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:18.725776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583d76a-11cb-4705-bfdf-0e12c3fe627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:18.726386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583d76a-11cb-4705-bfdf-0e12c3fe627e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:18.726664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583d76a-11cb-4705-bfdf-0e12c3fe627e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:18.726956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583d76a-11cb-4705-bfdf-0e12c3fe627e None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:18.727600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583d76a-11cb-4705-bfdf-0e12c3fe627e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:18.727897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583d76a-11cb-4705-bfdf-0e12c3fe627e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:18.729255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583d76a-11cb-4705-bfdf-0e12c3fe627e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:18.740670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 636/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:18.746687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94550a86-72cd-43b8-b325-0276b072ebe5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:18.785028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:18.866645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94550a86-72cd-43b8-b325-0276b072ebe5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:18.903404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f93db-db1f-40da-acae-efee3567779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:18.904026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f93db-db1f-40da-acae-efee3567779d None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:18.904300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f93db-db1f-40da-acae-efee3567779d None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:18.904565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f93db-db1f-40da-acae-efee3567779d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:18.911136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f93db-db1f-40da-acae-efee3567779d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:18.912950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f93db-db1f-40da-acae-efee3567779d None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-526f93db-db1f-40da-acae-efee3567779d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:36:18.923923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:18.924989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:18.926137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:36:18.926137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:36:18.926137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:36:18.926137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:36:18.926137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:36:18.926137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:36:18.926137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:18.926137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:18.926137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 635/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:18.931178 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583d76a-11cb-4705-bfdf-0e12c3fe627e None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:18.989611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:19.032757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583d76a-11cb-4705-bfdf-0e12c3fe627e None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:19.065346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df4cce-1156-4025-b700-7dc40f32302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:19.065883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df4cce-1156-4025-b700-7dc40f32302e None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:19.066164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df4cce-1156-4025-b700-7dc40f32302e None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:19.066438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df4cce-1156-4025-b700-7dc40f32302e None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:19.067156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df4cce-1156-4025-b700-7dc40f32302e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:19.067467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df4cce-1156-4025-b700-7dc40f32302e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:19.069446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df4cce-1156-4025-b700-7dc40f32302e None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:19.081486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 637/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:19.088274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f93db-db1f-40da-acae-efee3567779d None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:19.183022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:19.192140 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f93db-db1f-40da-acae-efee3567779d None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:19.229731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd22729-97e5-480b-bd7f-54b017247e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:19.230473 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd22729-97e5-480b-bd7f-54b017247e5a None admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:19.230789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd22729-97e5-480b-bd7f-54b017247e5a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:19.231079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd22729-97e5-480b-bd7f-54b017247e5a None admin] PATH_INFO: `/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/1485acc3d3e649168b8a1c69d0bbf12f/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:19.233372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd22729-97e5-480b-bd7f-54b017247e5a None admin] RBAC: Authorizing `identity:create_grant(project_id=fb3430537ddd42f9b69fbbb792f22785, user_id=1485acc3d3e649168b8a1c69d0bbf12f, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:19.234956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd22729-97e5-480b-bd7f-54b017247e5a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:19.248687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 636/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 11:36:19 2022] PUT /identity/v3/projects/fb3430537ddd42f9b69fbbb792f22785/users/1485acc3d3e649168b8a1c69d0bbf12f/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:36:21.161435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecebabe-3f7b-412b-ae16-b8f4817eebc2 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:21.161963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecebabe-3f7b-412b-ae16-b8f4817eebc2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:21.161963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecebabe-3f7b-412b-ae16-b8f4817eebc2 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:21.164263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 638/1274] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:36:21.169617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592105e6-9b97-4d61-b7c9-a53c3220455a None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:21.170067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592105e6-9b97-4d61-b7c9-a53c3220455a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:21.170169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592105e6-9b97-4d61-b7c9-a53c3220455a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:21.188869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-592105e6-9b97-4d61-b7c9-a53c3220455a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:21.190053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-592105e6-9b97-4d61-b7c9-a53c3220455a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:21.262318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 637/1275] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:36:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:36:21.544713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecebabe-3f7b-412b-ae16-b8f4817eebc2 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:21.653511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecebabe-3f7b-412b-ae16-b8f4817eebc2 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:21.671382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:21.689119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331789f6-c2d6-4dbb-a364-7a01a7a2b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:21.689740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331789f6-c2d6-4dbb-a364-7a01a7a2b5d6 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:21.690018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331789f6-c2d6-4dbb-a364-7a01a7a2b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:21.690291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331789f6-c2d6-4dbb-a364-7a01a7a2b5d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:21.700733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331789f6-c2d6-4dbb-a364-7a01a7a2b5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-331789f6-c2d6-4dbb-a364-7a01a7a2b5d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 11:36:21.705383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:21.706479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:21.707359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 639/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 11:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:21.713087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592105e6-9b97-4d61-b7c9-a53c3220455a None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:21.798858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:21.818044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592105e6-9b97-4d61-b7c9-a53c3220455a None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:21.853427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a674c-0316-44c1-bfc5-6f9a3d0ab92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:21.854032 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a674c-0316-44c1-bfc5-6f9a3d0ab92b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:21.854310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a674c-0316-44c1-bfc5-6f9a3d0ab92b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:21.854582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a674c-0316-44c1-bfc5-6f9a3d0ab92b None admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:21.855340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a674c-0316-44c1-bfc5-6f9a3d0ab92b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:21.855643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a674c-0316-44c1-bfc5-6f9a3d0ab92b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:21.857004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a674c-0316-44c1-bfc5-6f9a3d0ab92b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:21.864933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 638/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 11:36:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:21.871094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331789f6-c2d6-4dbb-a364-7a01a7a2b5d6 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:21.973350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331789f6-c2d6-4dbb-a364-7a01a7a2b5d6 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:22.006646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8c2e8-82e2-4899-a5ff-a54144fc6044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:22.007793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8c2e8-82e2-4899-a5ff-a54144fc6044 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:22.008093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8c2e8-82e2-4899-a5ff-a54144fc6044 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:22.008371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8c2e8-82e2-4899-a5ff-a54144fc6044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:22.018611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8c2e8-82e2-4899-a5ff-a54144fc6044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:22.020079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8c2e8-82e2-4899-a5ff-a54144fc6044 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-c0e8c2e8-82e2-4899-a5ff-a54144fc6044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:22.035017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:22.036115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:22.037325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:22.037325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:22.037325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:22.037325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 640/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:22.043813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a674c-0316-44c1-bfc5-6f9a3d0ab92b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:22.151302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a674c-0316-44c1-bfc5-6f9a3d0ab92b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:22.184074 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d5be1-73a8-4297-9cf7-213fa0128bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:22.184688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d5be1-73a8-4297-9cf7-213fa0128bc5 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:22.184927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d5be1-73a8-4297-9cf7-213fa0128bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:22.185194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d5be1-73a8-4297-9cf7-213fa0128bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:22.185823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d5be1-73a8-4297-9cf7-213fa0128bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:22.186127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d5be1-73a8-4297-9cf7-213fa0128bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:22.187516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d5be1-73a8-4297-9cf7-213fa0128bc5 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:22.199651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 639/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:36:22.205615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8c2e8-82e2-4899-a5ff-a54144fc6044 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:22.238986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:22.308088 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8c2e8-82e2-4899-a5ff-a54144fc6044 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:22.342258 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5cd5-d307-4bb2-9732-8a728544fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:22.342919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5cd5-d307-4bb2-9732-8a728544fb85 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:22.343200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5cd5-d307-4bb2-9732-8a728544fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:22.343473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5cd5-d307-4bb2-9732-8a728544fb85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:22.351328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5cd5-d307-4bb2-9732-8a728544fb85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:22.352780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5cd5-d307-4bb2-9732-8a728544fb85 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-111a5cd5-d307-4bb2-9732-8a728544fb85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 11:36:22.363419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:22.364536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:22.366019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 641/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:22.370866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d5be1-73a8-4297-9cf7-213fa0128bc5 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:22.374607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:22.474010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d5be1-73a8-4297-9cf7-213fa0128bc5 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:22.510331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd47ee-9b90-4dc8-96bc-c1c9716e15d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:22.510983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd47ee-9b90-4dc8-96bc-c1c9716e15d7 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:22.511266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd47ee-9b90-4dc8-96bc-c1c9716e15d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:22.511562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd47ee-9b90-4dc8-96bc-c1c9716e15d7 None admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:22.512314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd47ee-9b90-4dc8-96bc-c1c9716e15d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:22.512638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd47ee-9b90-4dc8-96bc-c1c9716e15d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:22.514142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd47ee-9b90-4dc8-96bc-c1c9716e15d7 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:22.532087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 640/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 11:36:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:22.538525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5cd5-d307-4bb2-9732-8a728544fb85 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:22.628918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:22.638755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5cd5-d307-4bb2-9732-8a728544fb85 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:22.671886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5014657-5591-4c6e-9ab2-74e837e98489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:22.672484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014657-5591-4c6e-9ab2-74e837e98489 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:22.672760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014657-5591-4c6e-9ab2-74e837e98489 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:22.673027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014657-5591-4c6e-9ab2-74e837e98489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:22.739123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5014657-5591-4c6e-9ab2-74e837e98489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:22.741046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5014657-5591-4c6e-9ab2-74e837e98489 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:22.827775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:22.839085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 642/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 11:36:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 11:36:22.845386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd47ee-9b90-4dc8-96bc-c1c9716e15d7 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:22.910310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:22.950870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd47ee-9b90-4dc8-96bc-c1c9716e15d7 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:22.985278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4ad99-304f-42cb-b67b-264930cb07ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:22.985897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4ad99-304f-42cb-b67b-264930cb07ae None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:22.986178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4ad99-304f-42cb-b67b-264930cb07ae None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:22.986454 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4ad99-304f-42cb-b67b-264930cb07ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:22.997371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4ad99-304f-42cb-b67b-264930cb07ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:22.998757 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4ad99-304f-42cb-b67b-264930cb07ae None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-32b4ad99-304f-42cb-b67b-264930cb07ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 11:36:23.014216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:23.015432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 11:36:23.016532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 11:36:23.016532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 11:36:23.016532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:23.016532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 641/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:23.021212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5014657-5591-4c6e-9ab2-74e837e98489 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:23.119643 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5014657-5591-4c6e-9ab2-74e837e98489 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:23.159291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563e43f-d5bf-4327-b544-b893fc53f6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:23.159898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563e43f-d5bf-4327-b544-b893fc53f6d8 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:23.160180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563e43f-d5bf-4327-b544-b893fc53f6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:23.160455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563e43f-d5bf-4327-b544-b893fc53f6d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:23.161099 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563e43f-d5bf-4327-b544-b893fc53f6d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:23.161403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563e43f-d5bf-4327-b544-b893fc53f6d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:23.162984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563e43f-d5bf-4327-b544-b893fc53f6d8 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:23.174461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 643/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 11:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:23.181536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4ad99-304f-42cb-b67b-264930cb07ae None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:23.292989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4ad99-304f-42cb-b67b-264930cb07ae None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:23.306338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:23.328712 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb5126-d956-4ae2-b30a-8fe1c5581a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:23.329343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb5126-d956-4ae2-b30a-8fe1c5581a96 None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:23.329623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb5126-d956-4ae2-b30a-8fe1c5581a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:23.329900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb5126-d956-4ae2-b30a-8fe1c5581a96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:23.337685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb5126-d956-4ae2-b30a-8fe1c5581a96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:23.339221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb5126-d956-4ae2-b30a-8fe1c5581a96 None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application [None req-abeb5126-d956-4ae2-b30a-8fe1c5581a96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 11:36:23.350741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:23.351888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:23.352824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 11:36:23.352824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 11:36:23.352824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 11:36:23.352824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 11:36:23.352824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 11:36:23.352824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 11:36:23.352824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 11:36:23.352824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: ERROR keystone.server.flask.application Aug 24 11:36:23.352824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 642/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 11:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:23.357999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563e43f-d5bf-4327-b544-b893fc53f6d8 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:23.409214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:23.458678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563e43f-d5bf-4327-b544-b893fc53f6d8 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:23.502062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d982a-f9be-4903-8669-06640738f341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:23.502672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d982a-f9be-4903-8669-06640738f341 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:23.502981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d982a-f9be-4903-8669-06640738f341 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:23.503412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d982a-f9be-4903-8669-06640738f341 None admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:23.504496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d982a-f9be-4903-8669-06640738f341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:23.504975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d982a-f9be-4903-8669-06640738f341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:23.507397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d982a-f9be-4903-8669-06640738f341 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:23.519948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 644/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 11:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:23.526870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb5126-d956-4ae2-b30a-8fe1c5581a96 None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:23.629144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb5126-d956-4ae2-b30a-8fe1c5581a96 None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:23.663403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55351d74-443e-4f20-afcc-69a9a9a8f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:23.664003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55351d74-443e-4f20-afcc-69a9a9a8f24a None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:23.664280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55351d74-443e-4f20-afcc-69a9a9a8f24a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:23.664560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55351d74-443e-4f20-afcc-69a9a9a8f24a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:23.665279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55351d74-443e-4f20-afcc-69a9a9a8f24a None admin] RBAC: Adding query filter params (role.id=2356e5c29e3c4ce9a64d4bd70b4615ea, scope.project.id=fb3430537ddd42f9b69fbbb792f22785, user.id=1485acc3d3e649168b8a1c69d0bbf12f) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:23.665585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55351d74-443e-4f20-afcc-69a9a9a8f24a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:23.667032 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55351d74-443e-4f20-afcc-69a9a9a8f24a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:23.672900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 643/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 11:36:23 2022] GET /identity/v3/role_assignments?user.id=1485acc3d3e649168b8a1c69d0bbf12f&scope.project.id=fb3430537ddd42f9b69fbbb792f22785&role.id=2356e5c29e3c4ce9a64d4bd70b4615ea => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:25.577699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719aea6-2ba5-4252-921f-98bf42124959 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:25.578259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719aea6-2ba5-4252-921f-98bf42124959 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:25.578259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719aea6-2ba5-4252-921f-98bf42124959 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:25.579607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 645/1288] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:36:25.584875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d717e0-5875-412e-803d-9c204e6f7c79 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:25.585334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d717e0-5875-412e-803d-9c204e6f7c79 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:25.585430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d717e0-5875-412e-803d-9c204e6f7c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:25.603839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-20d717e0-5875-412e-803d-9c204e6f7c79 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:25.605024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-20d717e0-5875-412e-803d-9c204e6f7c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:25.638354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:25.684264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 644/1289] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:36:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:36:25.961455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719aea6-2ba5-4252-921f-98bf42124959 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:26.062314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719aea6-2ba5-4252-921f-98bf42124959 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:26.073149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:26.097724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9560-c909-4303-bf35-5b37957f060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:26.098385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9560-c909-4303-bf35-5b37957f060f None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:26.098686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9560-c909-4303-bf35-5b37957f060f None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:26.099005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9560-c909-4303-bf35-5b37957f060f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:26.100218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b9560-c909-4303-bf35-5b37957f060f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:26.101661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b9560-c909-4303-bf35-5b37957f060f None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-4d9b9560-c909-4303-bf35-5b37957f060f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:26.111208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:26.112824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:26.113999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 646/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:36:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:26.118714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d717e0-5875-412e-803d-9c204e6f7c79 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:26.221770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d717e0-5875-412e-803d-9c204e6f7c79 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:26.263730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e0475-9609-4427-91b0-da44232bb0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:26.264603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e0475-9609-4427-91b0-da44232bb0ac None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:26.264929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e0475-9609-4427-91b0-da44232bb0ac None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:26.265298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e0475-9609-4427-91b0-da44232bb0ac None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:26.266103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e0475-9609-4427-91b0-da44232bb0ac None admin] RBAC: Adding query filter params (name=placement) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:26.266479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e0475-9609-4427-91b0-da44232bb0ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:26.268297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e0475-9609-4427-91b0-da44232bb0ac None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:26.275620 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 645/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Wed Aug 24 11:36:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:26.281760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9560-c909-4303-bf35-5b37957f060f None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:26.387744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9560-c909-4303-bf35-5b37957f060f None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:26.421581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dc00d-063d-4d64-986a-e169313276f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:26.422206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dc00d-063d-4d64-986a-e169313276f1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:26.422508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dc00d-063d-4d64-986a-e169313276f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:26.422825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dc00d-063d-4d64-986a-e169313276f1 None admin] PATH_INFO: `/v3/services` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:26.423488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dc00d-063d-4d64-986a-e169313276f1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:26.423793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dc00d-063d-4d64-986a-e169313276f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:26.425209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dc00d-063d-4d64-986a-e169313276f1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:26.430122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 647/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Wed Aug 24 11:36:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:36:28.373117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28f82-cfbd-4281-94e7-c3fd59a19b63 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:28.373688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28f82-cfbd-4281-94e7-c3fd59a19b63 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:28.373688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28f82-cfbd-4281-94e7-c3fd59a19b63 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:28.375124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 646/1293] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:36:28.380352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dba3d0-96b4-4c6d-ac18-390f93ac8b21 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:28.380815 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dba3d0-96b4-4c6d-ac18-390f93ac8b21 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:28.380924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dba3d0-96b4-4c6d-ac18-390f93ac8b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:28.402577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e2dba3d0-96b4-4c6d-ac18-390f93ac8b21 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:28.403810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e2dba3d0-96b4-4c6d-ac18-390f93ac8b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:28.433074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:28.469657 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 648/1294] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:36:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:36:28.740041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28f82-cfbd-4281-94e7-c3fd59a19b63 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:28.772388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:28.845964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28f82-cfbd-4281-94e7-c3fd59a19b63 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:28.879978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2111b-0524-4341-a6b3-38ab31904d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:28.881374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2111b-0524-4341-a6b3-38ab31904d2a None admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:28.881500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2111b-0524-4341-a6b3-38ab31904d2a None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:28.881784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2111b-0524-4341-a6b3-38ab31904d2a None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:28.882889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2111b-0524-4341-a6b3-38ab31904d2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:28.884256 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2111b-0524-4341-a6b3-38ab31904d2a None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:28.898932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 647/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 11:36:28 2022] POST /identity/v3/services => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:36:30.823242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c77311-34a1-4b84-b928-f58dc6a92dad None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:30.823802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c77311-34a1-4b84-b928-f58dc6a92dad None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:30.823802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c77311-34a1-4b84-b928-f58dc6a92dad None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:30.825138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 649/1296] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:36:30.830599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fff001-6643-4419-90ea-137bdb896122 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:30.831063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fff001-6643-4419-90ea-137bdb896122 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:30.831163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fff001-6643-4419-90ea-137bdb896122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:30.848952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-51fff001-6643-4419-90ea-137bdb896122 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:30.850741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-51fff001-6643-4419-90ea-137bdb896122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:30.925588 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 648/1297] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:36:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:36:31.202023 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c77311-34a1-4b84-b928-f58dc6a92dad None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:31.315314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c77311-34a1-4b84-b928-f58dc6a92dad None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:31.349391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce8a08-5482-41ba-b720-68c34f20e601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:31.350256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce8a08-5482-41ba-b720-68c34f20e601 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:31.350540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce8a08-5482-41ba-b720-68c34f20e601 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:31.350841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce8a08-5482-41ba-b720-68c34f20e601 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:31.351429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce8a08-5482-41ba-b720-68c34f20e601 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:31.352788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce8a08-5482-41ba-b720-68c34f20e601 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-e9ce8a08-5482-41ba-b720-68c34f20e601 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:31.361280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:31.362492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:31.363755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 650/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:36:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:31.369054 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fff001-6643-4419-90ea-137bdb896122 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:31.387798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:31.471325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fff001-6643-4419-90ea-137bdb896122 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:31.510489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da5145-c277-415f-a98f-bed5bebba20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:31.511128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da5145-c277-415f-a98f-bed5bebba20b None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:31.511410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da5145-c277-415f-a98f-bed5bebba20b None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:31.511686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da5145-c277-415f-a98f-bed5bebba20b None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:31.512311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da5145-c277-415f-a98f-bed5bebba20b None admin] RBAC: Adding query filter params (name=placement) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:31.512613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da5145-c277-415f-a98f-bed5bebba20b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:31.514010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da5145-c277-415f-a98f-bed5bebba20b None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:31.519178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 649/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Wed Aug 24 11:36:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:31.525428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce8a08-5482-41ba-b720-68c34f20e601 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:31.557394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:31.626525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce8a08-5482-41ba-b720-68c34f20e601 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:31.658928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e885b6a-85c0-4bb0-9a70-7ec3c9f32c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:31.659526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e885b6a-85c0-4bb0-9a70-7ec3c9f32c19 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:31.659801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e885b6a-85c0-4bb0-9a70-7ec3c9f32c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:31.660069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e885b6a-85c0-4bb0-9a70-7ec3c9f32c19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:31.660761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e885b6a-85c0-4bb0-9a70-7ec3c9f32c19 None admin] RBAC: Adding query filter params (interface=public, service_id=b155d1f25fd14653adade3b861dea47a, region_id=RegionOne) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:31.661064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e885b6a-85c0-4bb0-9a70-7ec3c9f32c19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:31.663161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e885b6a-85c0-4bb0-9a70-7ec3c9f32c19 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:31.668219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 651/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 11:36:31 2022] GET /identity/v3/endpoints?service_id=b155d1f25fd14653adade3b861dea47a&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:31.673933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da5145-c277-415f-a98f-bed5bebba20b None admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:31.754479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:31.773134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da5145-c277-415f-a98f-bed5bebba20b None admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:31.810500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b79f7-1394-4375-b362-ee3622c88f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:31.811136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b79f7-1394-4375-b362-ee3622c88f9e None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:31.811415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b79f7-1394-4375-b362-ee3622c88f9e None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:31.811687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b79f7-1394-4375-b362-ee3622c88f9e None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:31.812282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b79f7-1394-4375-b362-ee3622c88f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:31.813689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b79f7-1394-4375-b362-ee3622c88f9e None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:31.821147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 650/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 11:36:31 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:36:33.719370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ff9b-2be1-41cb-b4d7-9dbd63b6c27c None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:33.719893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ff9b-2be1-41cb-b4d7-9dbd63b6c27c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:33.719985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ff9b-2be1-41cb-b4d7-9dbd63b6c27c None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:33.721277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 652/1302] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:36:33.727652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25db4a-78c8-491a-8876-0ace2d32afc5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:33.728100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25db4a-78c8-491a-8876-0ace2d32afc5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:33.728204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25db4a-78c8-491a-8876-0ace2d32afc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:33.746643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4a25db4a-78c8-491a-8876-0ace2d32afc5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:36:33.747884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4a25db4a-78c8-491a-8876-0ace2d32afc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:36:33.814359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 651/1303] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:36:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 11:36:34.103261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ff9b-2be1-41cb-b4d7-9dbd63b6c27c None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:34.201329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:34.211400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ff9b-2be1-41cb-b4d7-9dbd63b6c27c None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:34.257556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913f2a-1b58-48da-a810-2d44e17fe9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:34.258551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913f2a-1b58-48da-a810-2d44e17fe9f1 None admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:34.258863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913f2a-1b58-48da-a810-2d44e17fe9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:34.259210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97913f2a-1b58-48da-a810-2d44e17fe9f1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:34.259800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97913f2a-1b58-48da-a810-2d44e17fe9f1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:34.261165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97913f2a-1b58-48da-a810-2d44e17fe9f1 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application [None req-97913f2a-1b58-48da-a810-2d44e17fe9f1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 11:36:34.270113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 11:36:34.271514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application with Lock( Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self._enter() Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application return self.creator() Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application created_value = creator( Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: ERROR keystone.server.flask.application Aug 24 11:36:34.272681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 653/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 11:36:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 11:36:34.277925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25db4a-78c8-491a-8876-0ace2d32afc5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:34.359816 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:34.383769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25db4a-78c8-491a-8876-0ace2d32afc5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:34.416587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bced7c9-d7e3-482d-9338-565b6d3635bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:34.417182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bced7c9-d7e3-482d-9338-565b6d3635bb None admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:34.417460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bced7c9-d7e3-482d-9338-565b6d3635bb None admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:34.417728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bced7c9-d7e3-482d-9338-565b6d3635bb None admin] PATH_INFO: `/v3/services` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:34.418338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bced7c9-d7e3-482d-9338-565b6d3635bb None admin] RBAC: Adding query filter params (name=placement) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:36:34.418635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bced7c9-d7e3-482d-9338-565b6d3635bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:34.420018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bced7c9-d7e3-482d-9338-565b6d3635bb None admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:34.424979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 652/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Wed Aug 24 11:36:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:36:34.431525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913f2a-1b58-48da-a810-2d44e17fe9f1 None admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:36:34.532088 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97913f2a-1b58-48da-a810-2d44e17fe9f1 None admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:36:34.568055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67cb96-f289-4a3a-bcf1-88895e174a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:36:34.568812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67cb96-f289-4a3a-bcf1-88895e174a46 None admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:36:34.569095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67cb96-f289-4a3a-bcf1-88895e174a46 None admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:36:34.569368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67cb96-f289-4a3a-bcf1-88895e174a46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:36:34.570031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67cb96-f289-4a3a-bcf1-88895e174a46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:36:34.571428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67cb96-f289-4a3a-bcf1-88895e174a46 None admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:36:34.592284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 654/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:36:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:36:44.422124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=30 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:44.588383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:39.576182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4b90e-a1ae-4195-8f0e-769366ec2395 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:39.577220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4b90e-a1ae-4195-8f0e-769366ec2395 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:39.577705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4b90e-a1ae-4195-8f0e-769366ec2395 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:39.585395 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbedea5-b5af-4aa5-bacd-95dd36652f75 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:39.586253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbedea5-b5af-4aa5-bacd-95dd36652f75 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:39.586754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbedea5-b5af-4aa5-bacd-95dd36652f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:39.591516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 653/1307] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:37:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:37:39.697334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-fcbedea5-b5af-4aa5-bacd-95dd36652f75 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:39.698638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fcbedea5-b5af-4aa5-bacd-95dd36652f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:39.851352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 655/1308] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:40.139120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b7d15-db23-4ea5-b1cf-f8f3a58baf89 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:40.139401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b7d15-db23-4ea5-b1cf-f8f3a58baf89 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:40.139844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b7d15-db23-4ea5-b1cf-f8f3a58baf89 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:40.141269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 654/1309] 10.222.0.59 () {54 vars in 965 bytes} [Wed Aug 24 11:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:37:40.148218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ccd9-3087-4b8a-9d39-b1d36c9cc4c1 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:40.148575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ccd9-3087-4b8a-9d39-b1d36c9cc4c1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:40.148938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ccd9-3087-4b8a-9d39-b1d36c9cc4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:40.233884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f315ccd9-3087-4b8a-9d39-b1d36c9cc4c1 None None] MFA Rules not processed for user `9b072d5669e34ad5b7b52a4a6e26700b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:40.235037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f315ccd9-3087-4b8a-9d39-b1d36c9cc4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:40.256115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:40.317032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 656/1310] 10.222.0.59 () {58 vars in 1062 bytes} [Wed Aug 24 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:40.326056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b7d15-db23-4ea5-b1cf-f8f3a58baf89 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:40.327989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6b3b7d15-db23-4ea5-b1cf-f8f3a58baf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:40.463547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b7d15-db23-4ea5-b1cf-f8f3a58baf89 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:40.549733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220568d4-ac2f-4908-80b3-75df82139ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:40.550359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220568d4-ac2f-4908-80b3-75df82139ceb service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:40.550640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220568d4-ac2f-4908-80b3-75df82139ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:40.550931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220568d4-ac2f-4908-80b3-75df82139ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:40.552666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-220568d4-ac2f-4908-80b3-75df82139ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:40.617136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:40.688689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220568d4-ac2f-4908-80b3-75df82139ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:40.690822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220568d4-ac2f-4908-80b3-75df82139ceb service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:40.727566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 655/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:43.038914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d76b9-074b-45e5-a29c-fa75ddded58c None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:43.039479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d76b9-074b-45e5-a29c-fa75ddded58c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:43.039479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d76b9-074b-45e5-a29c-fa75ddded58c None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:43.041812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 657/1312] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:37:43.047209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1548f5-fcbb-4a25-b689-7dd875a583d1 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:43.047702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1548f5-fcbb-4a25-b689-7dd875a583d1 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:43.047804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1548f5-fcbb-4a25-b689-7dd875a583d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:43.125907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-cc1548f5-fcbb-4a25-b689-7dd875a583d1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:43.127987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-cc1548f5-fcbb-4a25-b689-7dd875a583d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:43.252608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 656/1313] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:43.548156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d76b9-074b-45e5-a29c-fa75ddded58c None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:43.550148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5d3d76b9-074b-45e5-a29c-fa75ddded58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:43.653780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d76b9-074b-45e5-a29c-fa75ddded58c None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:43.729373 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:43.732096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e49cf-79cf-4678-b327-3ebf1ac301a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:43.732915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e49cf-79cf-4678-b327-3ebf1ac301a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:43.733267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e49cf-79cf-4678-b327-3ebf1ac301a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:43.733716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e49cf-79cf-4678-b327-3ebf1ac301a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:43.735622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-561e49cf-79cf-4678-b327-3ebf1ac301a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:43.843531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e49cf-79cf-4678-b327-3ebf1ac301a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:43.844871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e49cf-79cf-4678-b327-3ebf1ac301a8 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:43.863693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 658/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:46.119724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3e3b9-7d49-4206-a188-1515c945e9e2 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:46.120521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3e3b9-7d49-4206-a188-1515c945e9e2 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:46.120683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3e3b9-7d49-4206-a188-1515c945e9e2 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:46.122320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 657/1315] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:37:46.128938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76480c85-797d-4350-b9e2-135795ebf9a3 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:46.129464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76480c85-797d-4350-b9e2-135795ebf9a3 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:46.129614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76480c85-797d-4350-b9e2-135795ebf9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:46.194739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-76480c85-797d-4350-b9e2-135795ebf9a3 None None] MFA Rules not processed for user `ab79d473dce94574b1e4da104bc02e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:46.195921 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-76480c85-797d-4350-b9e2-135795ebf9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:46.249405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:46.295109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 659/1316] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:37:46.579736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3e3b9-7d49-4206-a188-1515c945e9e2 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:46.582260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ece3e3b9-7d49-4206-a188-1515c945e9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:46.592355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:46.690968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3e3b9-7d49-4206-a188-1515c945e9e2 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:46.764523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2efcf1-e0e6-4589-b0c7-ddf0c82cf398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:46.765122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2efcf1-e0e6-4589-b0c7-ddf0c82cf398 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:46.765399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2efcf1-e0e6-4589-b0c7-ddf0c82cf398 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:46.765668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2efcf1-e0e6-4589-b0c7-ddf0c82cf398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:46.767449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0d2efcf1-e0e6-4589-b0c7-ddf0c82cf398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:46.834083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:46.884336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2efcf1-e0e6-4589-b0c7-ddf0c82cf398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:46.886402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2efcf1-e0e6-4589-b0c7-ddf0c82cf398 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:46.904806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 658/1317] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:49.357547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a34fe3-ff58-4b83-9344-06e51c37b74e None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:49.358115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a34fe3-ff58-4b83-9344-06e51c37b74e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:49.358115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a34fe3-ff58-4b83-9344-06e51c37b74e None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:49.359467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 660/1318] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:37:49.365506 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10563302-5832-49af-814e-1da286f89884 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:49.365927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10563302-5832-49af-814e-1da286f89884 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:49.366057 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10563302-5832-49af-814e-1da286f89884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:49.432769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-10563302-5832-49af-814e-1da286f89884 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:49.433976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-10563302-5832-49af-814e-1da286f89884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:49.532643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 659/1319] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:37:49.822180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a34fe3-ff58-4b83-9344-06e51c37b74e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:49.823758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f9a34fe3-ff58-4b83-9344-06e51c37b74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:49.930446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a34fe3-ff58-4b83-9344-06e51c37b74e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:50.003884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbada50-4497-4000-9cd4-99dcc4020abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:50.004489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbada50-4497-4000-9cd4-99dcc4020abd service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:50.004766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbada50-4497-4000-9cd4-99dcc4020abd service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:50.005038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbada50-4497-4000-9cd4-99dcc4020abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:50.006902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-acbada50-4497-4000-9cd4-99dcc4020abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:50.014191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:50.114810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbada50-4497-4000-9cd4-99dcc4020abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:50.116238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbada50-4497-4000-9cd4-99dcc4020abd service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:50.134674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 661/1320] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:52.801191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12fe37-ca9f-472a-b05a-f52ff2435b44 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:52.801758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12fe37-ca9f-472a-b05a-f52ff2435b44 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:52.801758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12fe37-ca9f-472a-b05a-f52ff2435b44 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:52.803138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 660/1321] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:37:52.808531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0aed-7b4a-48cb-9dce-986901a94543 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:52.808968 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0aed-7b4a-48cb-9dce-986901a94543 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:52.809173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0aed-7b4a-48cb-9dce-986901a94543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:52.887702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-40ed0aed-7b4a-48cb-9dce-986901a94543 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:52.888954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-40ed0aed-7b4a-48cb-9dce-986901a94543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:52.952941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:52.995882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 662/1322] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:37:53.304820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffeb3-54b9-4501-8747-333d4bf0151c None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:53.305127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffeb3-54b9-4501-8747-333d4bf0151c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:53.305399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ffeb3-54b9-4501-8747-333d4bf0151c None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:53.306753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 661/1323] 10.222.0.59 () {54 vars in 965 bytes} [Wed Aug 24 11:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:37:53.313069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584241f7-9ddd-4034-8012-30d1932f49a8 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:53.313351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584241f7-9ddd-4034-8012-30d1932f49a8 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:53.313622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584241f7-9ddd-4034-8012-30d1932f49a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:53.391758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-584241f7-9ddd-4034-8012-30d1932f49a8 None None] MFA Rules not processed for user `9b072d5669e34ad5b7b52a4a6e26700b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:53.393688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-584241f7-9ddd-4034-8012-30d1932f49a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:53.474596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 663/1324] 10.222.0.59 () {58 vars in 1062 bytes} [Wed Aug 24 11:37:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:37:53.483747 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffeb3-54b9-4501-8747-333d4bf0151c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:53.485327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-2c5ffeb3-54b9-4501-8747-333d4bf0151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:53.506097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:53.593989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ffeb3-54b9-4501-8747-333d4bf0151c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:53.671068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096891c-6753-4f87-adb1-b2373a58acf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:53.671671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096891c-6753-4f87-adb1-b2373a58acf6 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:53.671948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096891c-6753-4f87-adb1-b2373a58acf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:53.672241 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096891c-6753-4f87-adb1-b2373a58acf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:53.674326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3096891c-6753-4f87-adb1-b2373a58acf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:53.746123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:53.785738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096891c-6753-4f87-adb1-b2373a58acf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:53.787218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096891c-6753-4f87-adb1-b2373a58acf6 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:53.805634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 662/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:56.045410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74e450-312a-4fde-8e9c-c0d9738b375b None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:56.045971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74e450-312a-4fde-8e9c-c0d9738b375b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:56.045971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74e450-312a-4fde-8e9c-c0d9738b375b None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:56.047382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 664/1326] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:37:56.053500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c83a-8d1d-4774-b88d-8369681bc2a8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:56.053929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c83a-8d1d-4774-b88d-8369681bc2a8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:56.054043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c83a-8d1d-4774-b88d-8369681bc2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:56.123633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-00b8c83a-8d1d-4774-b88d-8369681bc2a8 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:56.124857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-00b8c83a-8d1d-4774-b88d-8369681bc2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:56.238509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 663/1327] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:56.519827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74e450-312a-4fde-8e9c-c0d9738b375b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:56.521401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ce74e450-312a-4fde-8e9c-c0d9738b375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:56.585551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:56.630405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74e450-312a-4fde-8e9c-c0d9738b375b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:56.710206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14b8e8-5e1c-4505-9590-5eb3237dec5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:56.710837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14b8e8-5e1c-4505-9590-5eb3237dec5c service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:56.711118 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14b8e8-5e1c-4505-9590-5eb3237dec5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:56.711391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14b8e8-5e1c-4505-9590-5eb3237dec5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:56.712988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6c14b8e8-5e1c-4505-9590-5eb3237dec5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:56.821638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:56.824009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14b8e8-5e1c-4505-9590-5eb3237dec5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:56.825664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14b8e8-5e1c-4505-9590-5eb3237dec5c service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:56.847012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 665/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:37:58.842359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8862fc-4e5a-4a86-a32b-8ace46495236 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:58.842899 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8862fc-4e5a-4a86-a32b-8ace46495236 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:58.843398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8862fc-4e5a-4a86-a32b-8ace46495236 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:58.844659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 664/1329] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:37:58.851017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647085f-fec1-4b8c-8c6d-af8f2f5da4ef None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:58.851579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647085f-fec1-4b8c-8c6d-af8f2f5da4ef None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:58.851579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647085f-fec1-4b8c-8c6d-af8f2f5da4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:58.934606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-9647085f-fec1-4b8c-8c6d-af8f2f5da4ef None None] MFA Rules not processed for user `ab79d473dce94574b1e4da104bc02e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:37:58.935852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9647085f-fec1-4b8c-8c6d-af8f2f5da4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:59.035655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 666/1330] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:37:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:37:59.332753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8862fc-4e5a-4a86-a32b-8ace46495236 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:37:59.335016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8a8862fc-4e5a-4a86-a32b-8ace46495236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:59.371339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:59.458440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8862fc-4e5a-4a86-a32b-8ace46495236 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:37:59.547674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd9e30-cf96-4888-9c5c-8e771a0d8849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:37:59.548782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd9e30-cf96-4888-9c5c-8e771a0d8849 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:37:59.549304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd9e30-cf96-4888-9c5c-8e771a0d8849 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:37:59.549827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd9e30-cf96-4888-9c5c-8e771a0d8849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:37:59.551720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-53fd9e30-cf96-4888-9c5c-8e771a0d8849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:37:59.649320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:59.689685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd9e30-cf96-4888-9c5c-8e771a0d8849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:37:59.690261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd9e30-cf96-4888-9c5c-8e771a0d8849 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:37:59.712655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 665/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:37:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:02.040105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c968a7-6080-4aa2-ae72-3364053d41c6 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:02.040633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c968a7-6080-4aa2-ae72-3364053d41c6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:02.040633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c968a7-6080-4aa2-ae72-3364053d41c6 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:02.041987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 667/1332] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:02.047368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a458550-b721-4d50-9474-7c1ca4db2107 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:02.048359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a458550-b721-4d50-9474-7c1ca4db2107 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:02.049026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a458550-b721-4d50-9474-7c1ca4db2107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:02.117144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-2a458550-b721-4d50-9474-7c1ca4db2107 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:02.118370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-2a458550-b721-4d50-9474-7c1ca4db2107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:02.218737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 666/1333] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:02.514475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c968a7-6080-4aa2-ae72-3364053d41c6 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:02.516049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f7c968a7-6080-4aa2-ae72-3364053d41c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:02.585892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:02.623067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c968a7-6080-4aa2-ae72-3364053d41c6 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:02.700282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452ab2b-93cb-4ed8-bd96-fe67f40d35ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:02.700883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452ab2b-93cb-4ed8-bd96-fe67f40d35ea service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:02.701162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452ab2b-93cb-4ed8-bd96-fe67f40d35ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:02.701442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452ab2b-93cb-4ed8-bd96-fe67f40d35ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:02.703072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9452ab2b-93cb-4ed8-bd96-fe67f40d35ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:02.821303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452ab2b-93cb-4ed8-bd96-fe67f40d35ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:02.822619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452ab2b-93cb-4ed8-bd96-fe67f40d35ea service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:02.833482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:02.842125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 668/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:04.801076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b522d-7192-48c9-941e-f2c4baac3969 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:04.801655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b522d-7192-48c9-941e-f2c4baac3969 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:04.801655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b522d-7192-48c9-941e-f2c4baac3969 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:04.803048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 667/1335] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:04.808238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f07a9-3247-47e5-9a21-3ed0fb4a4a22 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:04.808707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f07a9-3247-47e5-9a21-3ed0fb4a4a22 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:04.808819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f07a9-3247-47e5-9a21-3ed0fb4a4a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:04.879230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d73f07a9-3247-47e5-9a21-3ed0fb4a4a22 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:04.880721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d73f07a9-3247-47e5-9a21-3ed0fb4a4a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:04.976340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 669/1336] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:05.265872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b522d-7192-48c9-941e-f2c4baac3969 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:05.267485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a69b522d-7192-48c9-941e-f2c4baac3969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:05.309417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:05.376646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b522d-7192-48c9-941e-f2c4baac3969 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:05.451171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31fbf-bdb5-4014-bb22-234d640cf9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:05.451805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31fbf-bdb5-4014-bb22-234d640cf9db service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:05.452088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31fbf-bdb5-4014-bb22-234d640cf9db service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:05.452367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31fbf-bdb5-4014-bb22-234d640cf9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:05.454730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-30f31fbf-bdb5-4014-bb22-234d640cf9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:05.538278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:05.565799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f31fbf-bdb5-4014-bb22-234d640cf9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:05.567278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f31fbf-bdb5-4014-bb22-234d640cf9db service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:05.586493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 668/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:08.081215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969db89f-72a8-4045-b394-f0494789053c None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:08.081797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969db89f-72a8-4045-b394-f0494789053c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:08.081797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969db89f-72a8-4045-b394-f0494789053c None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:08.083171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 670/1338] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:38:08.088523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081b768-4428-43f2-a0fd-5f5878f75568 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:08.088915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081b768-4428-43f2-a0fd-5f5878f75568 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:08.089075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081b768-4428-43f2-a0fd-5f5878f75568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:08.158494 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a081b768-4428-43f2-a0fd-5f5878f75568 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:08.159805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a081b768-4428-43f2-a0fd-5f5878f75568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:08.259791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 669/1339] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:08.538960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969db89f-72a8-4045-b394-f0494789053c None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:08.540501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-969db89f-72a8-4045-b394-f0494789053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:08.620750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:08.649111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969db89f-72a8-4045-b394-f0494789053c None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:08.722572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b9eeb-745e-4b5c-a48c-eb33215500f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:08.723214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b9eeb-745e-4b5c-a48c-eb33215500f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:08.723494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b9eeb-745e-4b5c-a48c-eb33215500f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:08.723764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b9eeb-745e-4b5c-a48c-eb33215500f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:08.725369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-eb4b9eeb-745e-4b5c-a48c-eb33215500f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:08.834392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b9eeb-745e-4b5c-a48c-eb33215500f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:08.835827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b9eeb-745e-4b5c-a48c-eb33215500f3 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:08.854068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 671/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:12.879072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99950f-0d66-4f6c-a84c-90a7b7eebfcc None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:12.879882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99950f-0d66-4f6c-a84c-90a7b7eebfcc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:12.879882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99950f-0d66-4f6c-a84c-90a7b7eebfcc None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:12.881237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 670/1341] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:12.886540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e4cc-f0ab-4958-9d00-430a5ab14c77 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:12.886976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e4cc-f0ab-4958-9d00-430a5ab14c77 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:12.887128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e4cc-f0ab-4958-9d00-430a5ab14c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:12.893521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:12.960568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ffb1e4cc-f0ab-4958-9d00-430a5ab14c77 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:12.961774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ffb1e4cc-f0ab-4958-9d00-430a5ab14c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:13.061413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 672/1342] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:13.346434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99950f-0d66-4f6c-a84c-90a7b7eebfcc None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:13.348122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6c99950f-0d66-4f6c-a84c-90a7b7eebfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:13.400127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:13.460105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99950f-0d66-4f6c-a84c-90a7b7eebfcc None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:13.537097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db69ae-4e9b-4d9d-b007-b5055288d9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:13.537702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db69ae-4e9b-4d9d-b007-b5055288d9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:13.537979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db69ae-4e9b-4d9d-b007-b5055288d9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:13.538250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db69ae-4e9b-4d9d-b007-b5055288d9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:13.539880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a9db69ae-4e9b-4d9d-b007-b5055288d9b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:13.635993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:13.654152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db69ae-4e9b-4d9d-b007-b5055288d9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:13.655614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db69ae-4e9b-4d9d-b007-b5055288d9b1 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:13.674210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 671/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:16.248410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a4b9-90e0-43cf-bffe-2ceafaddce44 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:16.248814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a4b9-90e0-43cf-bffe-2ceafaddce44 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:16.249549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a4b9-90e0-43cf-bffe-2ceafaddce44 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:16.250601 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 673/1344] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:16.256222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73ec3-fe53-42ff-828c-e3d341f964da None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:16.256660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73ec3-fe53-42ff-828c-e3d341f964da None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:16.256773 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73ec3-fe53-42ff-828c-e3d341f964da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:16.330949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-bcd73ec3-fe53-42ff-828c-e3d341f964da None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:16.332163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-bcd73ec3-fe53-42ff-828c-e3d341f964da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:16.433668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 672/1345] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:16.711507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0a4b9-90e0-43cf-bffe-2ceafaddce44 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:16.713198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f8c0a4b9-90e0-43cf-bffe-2ceafaddce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:16.807839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:16.825846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0a4b9-90e0-43cf-bffe-2ceafaddce44 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:16.909236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb753475-8e6e-40e8-9323-16174ac977f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:16.909859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb753475-8e6e-40e8-9323-16174ac977f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:16.910135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb753475-8e6e-40e8-9323-16174ac977f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:16.910403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb753475-8e6e-40e8-9323-16174ac977f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:16.912130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fb753475-8e6e-40e8-9323-16174ac977f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:17.032761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb753475-8e6e-40e8-9323-16174ac977f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:17.034102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb753475-8e6e-40e8-9323-16174ac977f1 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:17.052281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 674/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:21.203699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56677b8-a21a-450b-8462-aa0602580fd6 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:21.204602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56677b8-a21a-450b-8462-aa0602580fd6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:21.204602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56677b8-a21a-450b-8462-aa0602580fd6 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:21.205686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 673/1347] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:21.211628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800027f-5b44-4418-95de-631c20dfe16b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:21.212145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800027f-5b44-4418-95de-631c20dfe16b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:21.212249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800027f-5b44-4418-95de-631c20dfe16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:21.231668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:21.295263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-7800027f-5b44-4418-95de-631c20dfe16b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:21.297461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7800027f-5b44-4418-95de-631c20dfe16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:21.425056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 675/1348] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:21.736088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56677b8-a21a-450b-8462-aa0602580fd6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:21.737879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d56677b8-a21a-450b-8462-aa0602580fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:21.815186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:21.883045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56677b8-a21a-450b-8462-aa0602580fd6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:21.975442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27ffa1-2339-4e2a-8cdb-a6592268ae5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:21.976787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ffa1-2339-4e2a-8cdb-a6592268ae5e service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:21.977069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ffa1-2339-4e2a-8cdb-a6592268ae5e service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:21.977343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ffa1-2339-4e2a-8cdb-a6592268ae5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:21.979502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1d27ffa1-2339-4e2a-8cdb-a6592268ae5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:22.110858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:22.115399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27ffa1-2339-4e2a-8cdb-a6592268ae5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:22.116858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27ffa1-2339-4e2a-8cdb-a6592268ae5e service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:22.136918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 674/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:27.334062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bccfb1-0c63-4cc0-9583-03a543668b76 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:27.334510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bccfb1-0c63-4cc0-9583-03a543668b76 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:27.334627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bccfb1-0c63-4cc0-9583-03a543668b76 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:27.336276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 676/1350] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:27.341835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6eaeb-6178-477b-a52c-0c511f9e10b7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:27.342220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6eaeb-6178-477b-a52c-0c511f9e10b7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:27.342405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6eaeb-6178-477b-a52c-0c511f9e10b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:27.499442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-90e6eaeb-6178-477b-a52c-0c511f9e10b7 None None] MFA Rules not processed for user `1485acc3d3e649168b8a1c69d0bbf12f`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:27.500575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-90e6eaeb-6178-477b-a52c-0c511f9e10b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:27.614762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 675/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:38:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:31.423383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=59 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:31.817710 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbcd7a-7100-48bf-a9f4-0cb0750a8507 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:31.818332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbcd7a-7100-48bf-a9f4-0cb0750a8507 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:31.818711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbcd7a-7100-48bf-a9f4-0cb0750a8507 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:31.820276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 677/1352] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:31.825852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0bfe3-bee8-41dc-8be3-8ed68f7894dd None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:31.826342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0bfe3-bee8-41dc-8be3-8ed68f7894dd None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:31.826445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0bfe3-bee8-41dc-8be3-8ed68f7894dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:31.886691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:31.911605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d1e0bfe3-bee8-41dc-8be3-8ed68f7894dd None None] MFA Rules not processed for user `1485acc3d3e649168b8a1c69d0bbf12f`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:31.912966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d1e0bfe3-bee8-41dc-8be3-8ed68f7894dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:32.033654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 676/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:38:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:33.355666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c873c8a-171e-46d1-b351-badcc7c94937 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:33.356182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c873c8a-171e-46d1-b351-badcc7c94937 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:33.356291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c873c8a-171e-46d1-b351-badcc7c94937 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:33.357628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 678/1354] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:33.363403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af258f-e26f-44a3-98a0-fa8e2e125c50 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:33.363856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af258f-e26f-44a3-98a0-fa8e2e125c50 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:33.363954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af258f-e26f-44a3-98a0-fa8e2e125c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:33.445949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-76af258f-e26f-44a3-98a0-fa8e2e125c50 None None] MFA Rules not processed for user `1485acc3d3e649168b8a1c69d0bbf12f`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:33.447191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-76af258f-e26f-44a3-98a0-fa8e2e125c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:33.489989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:33.564627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 677/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:38:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:38:36.999994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b1a3-c734-4890-9d52-16e4a4f0150e None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:37.000516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b1a3-c734-4890-9d52-16e4a4f0150e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:37.000516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b1a3-c734-4890-9d52-16e4a4f0150e None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:37.001901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 679/1356] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:37.007834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec4a7-1266-4f4e-9872-bd8685181706 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:37.008235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec4a7-1266-4f4e-9872-bd8685181706 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:37.008393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ec4a7-1266-4f4e-9872-bd8685181706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:37.102960 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-878ec4a7-1266-4f4e-9872-bd8685181706 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:37.104451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-878ec4a7-1266-4f4e-9872-bd8685181706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:37.230909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 678/1357] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:37.543611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a210d1-91e7-4507-a48d-de689b87d542 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:37.543890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a210d1-91e7-4507-a48d-de689b87d542 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:37.544322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a210d1-91e7-4507-a48d-de689b87d542 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:37.545863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 680/1358] 10.222.0.59 () {54 vars in 962 bytes} [Wed Aug 24 11:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:37.561702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142885bc-b7cc-4f7b-bdfe-52f92d777f7b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:37.562884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142885bc-b7cc-4f7b-bdfe-52f92d777f7b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:37.563378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142885bc-b7cc-4f7b-bdfe-52f92d777f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:37.585663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:37.659368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-142885bc-b7cc-4f7b-bdfe-52f92d777f7b None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:37.660677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-142885bc-b7cc-4f7b-bdfe-52f92d777f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:37.791304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 679/1359] 10.222.0.59 () {58 vars in 1059 bytes} [Wed Aug 24 11:38:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:38:37.800937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a210d1-91e7-4507-a48d-de689b87d542 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:37.802806 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c2a210d1-91e7-4507-a48d-de689b87d542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:37.969277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a210d1-91e7-4507-a48d-de689b87d542 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:38.050284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:38.100634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f567b83-4f74-43e7-af94-5ce44d7bf25f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:38.101385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f567b83-4f74-43e7-af94-5ce44d7bf25f service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:38.101728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f567b83-4f74-43e7-af94-5ce44d7bf25f service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:38.101925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f567b83-4f74-43e7-af94-5ce44d7bf25f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:38.103595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9f567b83-4f74-43e7-af94-5ce44d7bf25f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:38.205368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f567b83-4f74-43e7-af94-5ce44d7bf25f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:38.206994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f567b83-4f74-43e7-af94-5ce44d7bf25f service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:38.229043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 681/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:38:40.469665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf5d1b-feb5-4e92-a0dd-48b031d9dbfc None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:40.470212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf5d1b-feb5-4e92-a0dd-48b031d9dbfc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:40.470212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf5d1b-feb5-4e92-a0dd-48b031d9dbfc None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:40.471784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 680/1361] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:40.478064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59096fd-6e31-4bd8-af27-1ddd7f2bec80 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:40.478538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59096fd-6e31-4bd8-af27-1ddd7f2bec80 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:40.478646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59096fd-6e31-4bd8-af27-1ddd7f2bec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:40.575199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c59096fd-6e31-4bd8-af27-1ddd7f2bec80 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:40.576436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c59096fd-6e31-4bd8-af27-1ddd7f2bec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:40.630309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:40.709087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 682/1362] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:41.003212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf5d1b-feb5-4e92-a0dd-48b031d9dbfc None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:41.005030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-fecf5d1b-feb5-4e92-a0dd-48b031d9dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:41.078688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:41.173819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf5d1b-feb5-4e92-a0dd-48b031d9dbfc None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:41.311054 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05870f23-644f-4a0b-8f6e-17994d6ba9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:41.311774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05870f23-644f-4a0b-8f6e-17994d6ba9d5 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:41.312395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05870f23-644f-4a0b-8f6e-17994d6ba9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:41.312688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05870f23-644f-4a0b-8f6e-17994d6ba9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:41.314308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-05870f23-644f-4a0b-8f6e-17994d6ba9d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:41.340743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:41.426587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05870f23-644f-4a0b-8f6e-17994d6ba9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:41.428565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05870f23-644f-4a0b-8f6e-17994d6ba9d5 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:41.454894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 681/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:43.779659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84935171-5fba-4d3f-82ab-d9a1aad0bb09 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:43.780855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84935171-5fba-4d3f-82ab-d9a1aad0bb09 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:43.780855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84935171-5fba-4d3f-82ab-d9a1aad0bb09 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:43.781737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 683/1364] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:43.786988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24719dd-0b39-4b5b-a1d0-3fc9dcf2e7c7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:43.787420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24719dd-0b39-4b5b-a1d0-3fc9dcf2e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:43.787420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24719dd-0b39-4b5b-a1d0-3fc9dcf2e7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:43.865301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c24719dd-0b39-4b5b-a1d0-3fc9dcf2e7c7 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:43.866540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c24719dd-0b39-4b5b-a1d0-3fc9dcf2e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:43.980261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:43.991125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 682/1365] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:44.281450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede7ea-127e-4492-91bf-574df2baa101 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:44.281730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede7ea-127e-4492-91bf-574df2baa101 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:44.282245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ede7ea-127e-4492-91bf-574df2baa101 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:44.284125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 684/1366] 10.222.0.59 () {54 vars in 962 bytes} [Wed Aug 24 11:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:44.290053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b0105-4e70-4740-b4a4-c9dfc50d0afa None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:44.290471 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b0105-4e70-4740-b4a4-c9dfc50d0afa None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:44.290841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b0105-4e70-4740-b4a4-c9dfc50d0afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:44.396500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-024b0105-4e70-4740-b4a4-c9dfc50d0afa None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:44.397923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-024b0105-4e70-4740-b4a4-c9dfc50d0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:44.530292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 683/1367] 10.222.0.59 () {58 vars in 1059 bytes} [Wed Aug 24 11:38:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:44.538164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede7ea-127e-4492-91bf-574df2baa101 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:44.539695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d9ede7ea-127e-4492-91bf-574df2baa101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:44.696444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ede7ea-127e-4492-91bf-574df2baa101 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:44.719805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:44.826454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c47021-aed3-4ca5-81f2-fa91586070ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:44.827201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47021-aed3-4ca5-81f2-fa91586070ca service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:44.827285 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47021-aed3-4ca5-81f2-fa91586070ca service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:44.827572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47021-aed3-4ca5-81f2-fa91586070ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:44.829265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f1c47021-aed3-4ca5-81f2-fa91586070ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:44.923352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c47021-aed3-4ca5-81f2-fa91586070ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:44.924961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c47021-aed3-4ca5-81f2-fa91586070ca service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:44.944811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 685/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:45.346941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44696f1-5498-4149-a8e6-3a4e9931307a None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:45.347532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44696f1-5498-4149-a8e6-3a4e9931307a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:45.347532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44696f1-5498-4149-a8e6-3a4e9931307a None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:45.349082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 684/1369] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:45.354399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d180a-5d8d-4fb0-af48-375907b0f530 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:45.354695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d180a-5d8d-4fb0-af48-375907b0f530 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:45.355009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d180a-5d8d-4fb0-af48-375907b0f530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:45.390958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:45.429521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ab8d180a-5d8d-4fb0-af48-375907b0f530 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:45.430757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ab8d180a-5d8d-4fb0-af48-375907b0f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:45.542707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 686/1370] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:46.137435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7cea-77c6-44e9-8e83-66b141037531 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:46.137750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7cea-77c6-44e9-8e83-66b141037531 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:46.137992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7cea-77c6-44e9-8e83-66b141037531 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:46.140009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 685/1371] 10.222.0.59 () {54 vars in 964 bytes} [Wed Aug 24 11:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:46.145702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279778-af37-490b-8f1f-2f40d9f9f1c4 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:46.146213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279778-af37-490b-8f1f-2f40d9f9f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:46.146312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279778-af37-490b-8f1f-2f40d9f9f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:46.237055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b8279778-af37-490b-8f1f-2f40d9f9f1c4 None None] MFA Rules not processed for user `580a07e04f3e42a5bb2801e583a78a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:46.238277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b8279778-af37-490b-8f1f-2f40d9f9f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:46.288645 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:46.321503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 687/1372] 10.222.0.59 () {58 vars in 1061 bytes} [Wed Aug 24 11:38:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:46.329560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a7cea-77c6-44e9-8e83-66b141037531 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:46.331096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-768a7cea-77c6-44e9-8e83-66b141037531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:46.385418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:46.444172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a7cea-77c6-44e9-8e83-66b141037531 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:46.524728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7800a7-b7ab-49af-9719-8e7194b8ddae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:46.525219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7800a7-b7ab-49af-9719-8e7194b8ddae service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:46.525517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7800a7-b7ab-49af-9719-8e7194b8ddae service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:46.525782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7800a7-b7ab-49af-9719-8e7194b8ddae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:46.527538 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ce7800a7-b7ab-49af-9719-8e7194b8ddae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:46.645556 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:46.662445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7800a7-b7ab-49af-9719-8e7194b8ddae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:46.663937 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7800a7-b7ab-49af-9719-8e7194b8ddae service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:46.685481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 686/1373] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:47.046589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624cc94-0ed2-4709-984b-f76d720068ad None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:47.046838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624cc94-0ed2-4709-984b-f76d720068ad None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:47.047126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624cc94-0ed2-4709-984b-f76d720068ad None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:47.048505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 688/1374] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:47.053874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a69b5-f72a-416e-9e28-4915fbe63484 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:47.054165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a69b5-f72a-416e-9e28-4915fbe63484 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:47.054476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a69b5-f72a-416e-9e28-4915fbe63484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:47.123809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9f8a69b5-f72a-416e-9e28-4915fbe63484 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:47.125034 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9f8a69b5-f72a-416e-9e28-4915fbe63484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:47.233528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 687/1375] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:47.537904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624cc94-0ed2-4709-984b-f76d720068ad None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:47.539456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9624cc94-0ed2-4709-984b-f76d720068ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:47.693046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624cc94-0ed2-4709-984b-f76d720068ad None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:47.746317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:47.809618 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15913b4a-8e95-4f92-9c7b-1b9999c9d6d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:47.810859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913b4a-8e95-4f92-9c7b-1b9999c9d6d6 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:47.811146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913b4a-8e95-4f92-9c7b-1b9999c9d6d6 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:47.811478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913b4a-8e95-4f92-9c7b-1b9999c9d6d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:47.813119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-15913b4a-8e95-4f92-9c7b-1b9999c9d6d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:47.909512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15913b4a-8e95-4f92-9c7b-1b9999c9d6d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:47.911159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15913b4a-8e95-4f92-9c7b-1b9999c9d6d6 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:47.930176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 689/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:49.899110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889bc6-2955-4668-a619-e7c376521340 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:49.899674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889bc6-2955-4668-a619-e7c376521340 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:49.899674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889bc6-2955-4668-a619-e7c376521340 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:49.900999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 688/1377] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:49.906659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a61ccf-691b-4c8b-b9da-cf447ca6ba93 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:49.907354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a61ccf-691b-4c8b-b9da-cf447ca6ba93 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:49.907354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a61ccf-691b-4c8b-b9da-cf447ca6ba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:49.983413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-51a61ccf-691b-4c8b-b9da-cf447ca6ba93 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:49.984640 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-51a61ccf-691b-4c8b-b9da-cf447ca6ba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:49.991516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:50.091461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 690/1378] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:50.403830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889bc6-2955-4668-a619-e7c376521340 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:50.405390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-81889bc6-2955-4668-a619-e7c376521340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:50.471683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:50.570748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889bc6-2955-4668-a619-e7c376521340 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:50.704472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af8a16-8c08-4ec3-b6ab-e67ff80adb9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:50.705088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af8a16-8c08-4ec3-b6ab-e67ff80adb9f service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:50.705366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af8a16-8c08-4ec3-b6ab-e67ff80adb9f service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:50.705639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af8a16-8c08-4ec3-b6ab-e67ff80adb9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:50.707251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d8af8a16-8c08-4ec3-b6ab-e67ff80adb9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:50.727184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:50.816364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af8a16-8c08-4ec3-b6ab-e67ff80adb9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:50.817965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af8a16-8c08-4ec3-b6ab-e67ff80adb9f service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:50.838687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 689/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:52.882434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf732be-e077-4ae4-86a3-8dcbb15858b6 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.883045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf732be-e077-4ae4-86a3-8dcbb15858b6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.883198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf732be-e077-4ae4-86a3-8dcbb15858b6 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.885030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 691/1380] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:52.890903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b77c4-95cb-4c8e-91dc-89ab251480bd None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:52.891346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b77c4-95cb-4c8e-91dc-89ab251480bd None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:52.891346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b77c4-95cb-4c8e-91dc-89ab251480bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:52.974906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f72b77c4-95cb-4c8e-91dc-89ab251480bd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:52.976252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f72b77c4-95cb-4c8e-91dc-89ab251480bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:53.075617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:53.082560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 690/1381] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:53.374480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf732be-e077-4ae4-86a3-8dcbb15858b6 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:53.376489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-adf732be-e077-4ae4-86a3-8dcbb15858b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:53.529276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:53.542249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf732be-e077-4ae4-86a3-8dcbb15858b6 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:53.672518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9bc5f-2189-40eb-bc7d-8c8e965e279f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:53.673291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9bc5f-2189-40eb-bc7d-8c8e965e279f service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:53.673705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9bc5f-2189-40eb-bc7d-8c8e965e279f service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:53.674084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9bc5f-2189-40eb-bc7d-8c8e965e279f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:53.675847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-94e9bc5f-2189-40eb-bc7d-8c8e965e279f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:53.774387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9bc5f-2189-40eb-bc7d-8c8e965e279f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:53.776169 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9bc5f-2189-40eb-bc7d-8c8e965e279f service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:53.789647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:53.801083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 692/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:55.835421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d178949-4389-43cb-a7a4-d2608cdbc2bf None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:55.835421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d178949-4389-43cb-a7a4-d2608cdbc2bf None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:55.836213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d178949-4389-43cb-a7a4-d2608cdbc2bf None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:55.839833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 691/1383] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:38:55.846524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9e56-2e75-47fd-b07e-bcda6c345f4e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:55.847040 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9e56-2e75-47fd-b07e-bcda6c345f4e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:55.847370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9e56-2e75-47fd-b07e-bcda6c345f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:55.939166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-599a9e56-2e75-47fd-b07e-bcda6c345f4e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:55.940576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-599a9e56-2e75-47fd-b07e-bcda6c345f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:56.048326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 693/1384] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:38:56.359481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d178949-4389-43cb-a7a4-d2608cdbc2bf None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:56.361700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6d178949-4389-43cb-a7a4-d2608cdbc2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:56.527886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d178949-4389-43cb-a7a4-d2608cdbc2bf None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:56.604342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:56.664069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ee876-189e-4e45-8da7-0e528549a0b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:56.664846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ee876-189e-4e45-8da7-0e528549a0b3 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:56.665205 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ee876-189e-4e45-8da7-0e528549a0b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:56.665548 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ee876-189e-4e45-8da7-0e528549a0b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:56.667709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-af2ee876-189e-4e45-8da7-0e528549a0b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:56.770207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ee876-189e-4e45-8da7-0e528549a0b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:56.771909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ee876-189e-4e45-8da7-0e528549a0b3 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:56.790935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 692/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:38:58.788323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96b3d-957d-428c-b78f-99a998f5cfbe None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:58.789058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96b3d-957d-428c-b78f-99a998f5cfbe None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:58.789058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc96b3d-957d-428c-b78f-99a998f5cfbe None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:58.790341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 694/1386] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:38:58.799381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2c1f8-4e0c-4367-b862-7cd52479c632 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:58.799892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2c1f8-4e0c-4367-b862-7cd52479c632 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:58.800195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2c1f8-4e0c-4367-b862-7cd52479c632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:58.897646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-73f2c1f8-4e0c-4367-b862-7cd52479c632 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:38:58.899950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-73f2c1f8-4e0c-4367-b862-7cd52479c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:58.958972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:59.041289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 693/1387] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:38:59.343638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc96b3d-957d-428c-b78f-99a998f5cfbe None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:38:59.345875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6dc96b3d-957d-428c-b78f-99a998f5cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:59.452609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:59.541571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc96b3d-957d-428c-b78f-99a998f5cfbe None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:38:59.670879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903824a-2640-473a-b924-a63dbd8d9b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:38:59.671575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903824a-2640-473a-b924-a63dbd8d9b78 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:38:59.671886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903824a-2640-473a-b924-a63dbd8d9b78 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:38:59.672189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903824a-2640-473a-b924-a63dbd8d9b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:38:59.673982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1903824a-2640-473a-b924-a63dbd8d9b78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:38:59.724988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:59.795101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903824a-2640-473a-b924-a63dbd8d9b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:38:59.796914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903824a-2640-473a-b924-a63dbd8d9b78 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:38:59.818065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 695/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:01.783601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb7cc-355b-493b-a807-daedfdbf0c64 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:01.784167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb7cc-355b-493b-a807-daedfdbf0c64 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:01.784167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb7cc-355b-493b-a807-daedfdbf0c64 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:01.785498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 694/1389] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:01.790956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da62ea-66d3-42bf-86fa-59516dc55113 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:01.791407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da62ea-66d3-42bf-86fa-59516dc55113 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:01.791578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da62ea-66d3-42bf-86fa-59516dc55113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:01.844462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba6839-9fab-4861-861d-e3e57e80344e None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:01.844764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba6839-9fab-4861-861d-e3e57e80344e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:01.845068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba6839-9fab-4861-861d-e3e57e80344e None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:01.846577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 695/1390] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:39:01.854019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3a39d-60c7-4edd-8856-ff05ee2bcb6f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:01.854362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3a39d-60c7-4edd-8856-ff05ee2bcb6f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:01.854615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3a39d-60c7-4edd-8856-ff05ee2bcb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:01.862609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-13da62ea-66d3-42bf-86fa-59516dc55113 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:01.864469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-13da62ea-66d3-42bf-86fa-59516dc55113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:01.925846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-1ba3a39d-60c7-4edd-8856-ff05ee2bcb6f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:01.927086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1ba3a39d-60c7-4edd-8856-ff05ee2bcb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:01.972602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 696/1391] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:02.033220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 696/1392] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:02.273306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da62ea-66d3-42bf-86fa-59516dc55113 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:02.274578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-13da62ea-66d3-42bf-86fa-59516dc55113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:02.289057 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:02.354834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99397121-673f-448e-a118-5f401bc2c28d None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.355126 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99397121-673f-448e-a118-5f401bc2c28d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.355403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99397121-673f-448e-a118-5f401bc2c28d None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.356982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 697/1393] 10.222.0.59 () {54 vars in 967 bytes} [Wed Aug 24 11:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:02.361909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447759-9027-43fb-9a85-ed639e3044df None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.362202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447759-9027-43fb-9a85-ed639e3044df None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.362483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447759-9027-43fb-9a85-ed639e3044df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.380153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:02.394029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da62ea-66d3-42bf-86fa-59516dc55113 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:02.445836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-62447759-9027-43fb-9a85-ed639e3044df None None] MFA Rules not processed for user `bd3bd33cac7d4715bede59def04cdb92`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:02.447171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-62447759-9027-43fb-9a85-ed639e3044df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:02.517701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b86b9-ae5f-4e0b-9972-d0f5e9150777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:02.518327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b86b9-ae5f-4e0b-9972-d0f5e9150777 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.518611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b86b9-ae5f-4e0b-9972-d0f5e9150777 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.518918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b86b9-ae5f-4e0b-9972-d0f5e9150777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.520542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3d7b86b9-ae5f-4e0b-9972-d0f5e9150777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:02.529282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:02.529828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 698/1394] 10.222.0.59 () {58 vars in 1064 bytes} [Wed Aug 24 11:39:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:02.537854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447759-9027-43fb-9a85-ed639e3044df None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:02.545637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447759-9027-43fb-9a85-ed639e3044df None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:02.615627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b86b9-ae5f-4e0b-9972-d0f5e9150777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:02.616961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b86b9-ae5f-4e0b-9972-d0f5e9150777 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:02.630724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2466686-78b8-49bb-a614-0313b61a2100 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3bd33cac7d4715bede59def04cdb92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:02.631365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2466686-78b8-49bb-a614-0313b61a2100 service glance] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:02.631643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2466686-78b8-49bb-a614-0313b61a2100 service glance] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:02.631915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2466686-78b8-49bb-a614-0313b61a2100 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:02.633561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b2466686-78b8-49bb-a614-0313b61a2100 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:02.636553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 697/1395] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:02.667365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:02.766674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2466686-78b8-49bb-a614-0313b61a2100 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:02.768208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2466686-78b8-49bb-a614-0313b61a2100 service glance] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:02.789790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 699/1396] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:39:03.559919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df51d18-f6c4-4234-a61e-eecde1633f4e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:03.560655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df51d18-f6c4-4234-a61e-eecde1633f4e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:03.560655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df51d18-f6c4-4234-a61e-eecde1633f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:03.630657 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3df51d18-f6c4-4234-a61e-eecde1633f4e None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:03.632039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3df51d18-f6c4-4234-a61e-eecde1633f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:03.721333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:03.725435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 698/1397] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:39:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:03.770059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5f3a8-9dab-40e8-b984-2866a51942f2 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:03.770435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5f3a8-9dab-40e8-b984-2866a51942f2 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:03.770796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5f3a8-9dab-40e8-b984-2866a51942f2 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:03.772320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 700/1398] 10.222.0.59 () {54 vars in 943 bytes} [Wed Aug 24 11:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:03.780094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a64f-f46a-4a05-9cda-8e69002248d3 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:03.780402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a64f-f46a-4a05-9cda-8e69002248d3 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:03.780672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73a64f-f46a-4a05-9cda-8e69002248d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:03.858662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5e73a64f-f46a-4a05-9cda-8e69002248d3 None None] MFA Rules not processed for user `d81a9aefdc6c4ada9baca8097927c03a`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:03.859804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5e73a64f-f46a-4a05-9cda-8e69002248d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:03.973458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 699/1399] 10.222.0.59 () {58 vars in 1040 bytes} [Wed Aug 24 11:39:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:03.983249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5f3a8-9dab-40e8-b984-2866a51942f2 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:03.984781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d8c5f3a8-9dab-40e8-b984-2866a51942f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:04.129826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:04.132098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5f3a8-9dab-40e8-b984-2866a51942f2 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:04.240457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee629413-4278-475b-9e17-e0b2175c3188 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:04.241062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee629413-4278-475b-9e17-e0b2175c3188 service swift] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:04.241337 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee629413-4278-475b-9e17-e0b2175c3188 service swift] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:04.241602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee629413-4278-475b-9e17-e0b2175c3188 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:04.243266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ee629413-4278-475b-9e17-e0b2175c3188 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:04.333435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee629413-4278-475b-9e17-e0b2175c3188 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:04.335177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee629413-4278-475b-9e17-e0b2175c3188 service swift] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:04.343600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 701/1400] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:39:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:39:04.652945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a106105-e685-41b1-b67e-f5f194cf3f42 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:04.654213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a106105-e685-41b1-b67e-f5f194cf3f42 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:04.654213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a106105-e685-41b1-b67e-f5f194cf3f42 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:04.659220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 700/1401] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:04.661092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003869-3f7c-4f43-9ddb-7cdda0e09044 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:04.661555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003869-3f7c-4f43-9ddb-7cdda0e09044 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:04.661842 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003869-3f7c-4f43-9ddb-7cdda0e09044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:04.704693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:04.738781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-99003869-3f7c-4f43-9ddb-7cdda0e09044 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:04.740037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-99003869-3f7c-4f43-9ddb-7cdda0e09044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:04.855159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 702/1402] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:05.158338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a106105-e685-41b1-b67e-f5f194cf3f42 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:05.161634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5a106105-e685-41b1-b67e-f5f194cf3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:05.236159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:05.335940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a106105-e685-41b1-b67e-f5f194cf3f42 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:05.474426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccad52-e920-458c-bb12-21219b0b3dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:05.475082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccad52-e920-458c-bb12-21219b0b3dca service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:05.475360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccad52-e920-458c-bb12-21219b0b3dca service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:05.475628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccad52-e920-458c-bb12-21219b0b3dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:05.477403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c2ccad52-e920-458c-bb12-21219b0b3dca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:05.505019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:05.605484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccad52-e920-458c-bb12-21219b0b3dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:05.608226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccad52-e920-458c-bb12-21219b0b3dca service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:05.636600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 701/1403] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:07.695991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2aa9-0262-415b-8336-a130be401607 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:07.696553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2aa9-0262-415b-8336-a130be401607 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:07.696553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2aa9-0262-415b-8336-a130be401607 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:07.697864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 703/1404] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:07.704986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd92faa-a3ee-48fa-97fb-8599ab9a8673 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:07.705482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd92faa-a3ee-48fa-97fb-8599ab9a8673 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:07.705587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd92faa-a3ee-48fa-97fb-8599ab9a8673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:07.789536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5dd92faa-a3ee-48fa-97fb-8599ab9a8673 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:07.791116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5dd92faa-a3ee-48fa-97fb-8599ab9a8673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:07.902325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:07.910568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 702/1405] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:08.205877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2aa9-0262-415b-8336-a130be401607 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:08.207486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-301f2aa9-0262-415b-8336-a130be401607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:08.331495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:08.385617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2aa9-0262-415b-8336-a130be401607 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:08.520406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f39eb-ddbd-463d-9aea-50a69869535d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:08.520960 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f39eb-ddbd-463d-9aea-50a69869535d service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:08.521217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f39eb-ddbd-463d-9aea-50a69869535d service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:08.521492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f39eb-ddbd-463d-9aea-50a69869535d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:08.523182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-805f39eb-ddbd-463d-9aea-50a69869535d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:08.623660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:08.643889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f39eb-ddbd-463d-9aea-50a69869535d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:08.645597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f39eb-ddbd-463d-9aea-50a69869535d service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:08.664759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 704/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:10.743328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef11b6-7799-4336-82b7-9d929391ab9f None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:10.743902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef11b6-7799-4336-82b7-9d929391ab9f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:10.743902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef11b6-7799-4336-82b7-9d929391ab9f None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:10.745224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 703/1407] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:10.751632 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc58363-d4bd-44e4-a703-a0b31c04311f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:10.752470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc58363-d4bd-44e4-a703-a0b31c04311f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:10.753262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc58363-d4bd-44e4-a703-a0b31c04311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:10.880960 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-2bc58363-d4bd-44e4-a703-a0b31c04311f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:10.882460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-2bc58363-d4bd-44e4-a703-a0b31c04311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:11.035539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 705/1408] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:11.338816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef11b6-7799-4336-82b7-9d929391ab9f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:11.343013 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-07ef11b6-7799-4336-82b7-9d929391ab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:11.547328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef11b6-7799-4336-82b7-9d929391ab9f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:11.645192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:11.712218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484ae3c-2370-4b67-938a-13326c68bea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:11.712830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484ae3c-2370-4b67-938a-13326c68bea7 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:11.713106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484ae3c-2370-4b67-938a-13326c68bea7 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:11.713382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484ae3c-2370-4b67-938a-13326c68bea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:11.715649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7484ae3c-2370-4b67-938a-13326c68bea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:11.815396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484ae3c-2370-4b67-938a-13326c68bea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:11.817045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484ae3c-2370-4b67-938a-13326c68bea7 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:11.837626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 704/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:21.033291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=79 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:21.835086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=64 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:27.029809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3ba3a-f933-4a43-85e6-058a6cf7a4c8 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:27.030386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3ba3a-f933-4a43-85e6-058a6cf7a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:27.030386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3ba3a-f933-4a43-85e6-058a6cf7a4c8 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:27.031752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 706/1410] 10.222.0.59 () {54 vars in 918 bytes} [Wed Aug 24 11:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:27.036952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272e319-25d8-4bf5-979d-b367c5f51c5b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:27.037423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272e319-25d8-4bf5-979d-b367c5f51c5b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:27.037528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272e319-25d8-4bf5-979d-b367c5f51c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:27.114502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e272e319-25d8-4bf5-979d-b367c5f51c5b None None] MFA Rules not processed for user `1485acc3d3e649168b8a1c69d0bbf12f`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:27.115749 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e272e319-25d8-4bf5-979d-b367c5f51c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:27.224376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 705/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Aug 24 11:39:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:27.238475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098817a-bc86-486b-8464-836a6046a317 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:27.238762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098817a-bc86-486b-8464-836a6046a317 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:27.239083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098817a-bc86-486b-8464-836a6046a317 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:27.240390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 707/1412] 10.222.0.59 () {54 vars in 918 bytes} [Wed Aug 24 11:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:27.244980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b63285-d431-4674-9621-9dad45c49017 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:27.245271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b63285-d431-4674-9621-9dad45c49017 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:27.245548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b63285-d431-4674-9621-9dad45c49017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:27.323566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:27.328506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b9b63285-d431-4674-9621-9dad45c49017 None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:27.329486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b9b63285-d431-4674-9621-9dad45c49017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:27.446699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 706/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Aug 24 11:39:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:29.901188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0f2b-8439-4005-ba3d-8f603be1943e None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:29.901890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0f2b-8439-4005-ba3d-8f603be1943e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:29.901890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0f2b-8439-4005-ba3d-8f603be1943e None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:29.903168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:29.908599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ade1c7-a4fa-4959-9e6f-62a879b2ef7b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:29.909016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ade1c7-a4fa-4959-9e6f-62a879b2ef7b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:29.909151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ade1c7-a4fa-4959-9e6f-62a879b2ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:29.977186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c2ade1c7-a4fa-4959-9e6f-62a879b2ef7b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:29.978412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c2ade1c7-a4fa-4959-9e6f-62a879b2ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:30.037900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:30.082023 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:30.382749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0f2b-8439-4005-ba3d-8f603be1943e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:30.384341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8cdf0f2b-8439-4005-ba3d-8f603be1943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:30.533034 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0f2b-8439-4005-ba3d-8f603be1943e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:30.608484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:30.649794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdb1c3-1ca7-40f8-9e9e-daf97f250efe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:30.650317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdb1c3-1ca7-40f8-9e9e-daf97f250efe service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:30.650600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdb1c3-1ca7-40f8-9e9e-daf97f250efe service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:30.650983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdb1c3-1ca7-40f8-9e9e-daf97f250efe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:30.652610 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d7cdb1c3-1ca7-40f8-9e9e-daf97f250efe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:30.746722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdb1c3-1ca7-40f8-9e9e-daf97f250efe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:30.748375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdb1c3-1ca7-40f8-9e9e-daf97f250efe service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:30.768101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 709/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:31.677764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3965a33-5c68-48a6-8bfb-12d2b12eef84 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:31.678294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3965a33-5c68-48a6-8bfb-12d2b12eef84 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:31.678294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3965a33-5c68-48a6-8bfb-12d2b12eef84 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:31.679620 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:31.684829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3e7a7-d519-4b60-93db-d43e7ee0e377 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:31.685315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3e7a7-d519-4b60-93db-d43e7ee0e377 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:31.685422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3e7a7-d519-4b60-93db-d43e7ee0e377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:31.775857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-87a3e7a7-d519-4b60-93db-d43e7ee0e377 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:31.777065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-87a3e7a7-d519-4b60-93db-d43e7ee0e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:31.805002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:31.880943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:32.035651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3965a33-5c68-48a6-8bfb-12d2b12eef84 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:32.037177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a3965a33-5c68-48a6-8bfb-12d2b12eef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:32.185501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3965a33-5c68-48a6-8bfb-12d2b12eef84 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:32.230978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:32.309424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bc516-0499-446c-96ed-4c74e49534fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:32.310028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bc516-0499-446c-96ed-4c74e49534fc service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:32.310303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bc516-0499-446c-96ed-4c74e49534fc service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:32.310572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bc516-0499-446c-96ed-4c74e49534fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:32.312184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-201bc516-0499-446c-96ed-4c74e49534fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:32.401259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bc516-0499-446c-96ed-4c74e49534fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:32.403556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bc516-0499-446c-96ed-4c74e49534fc service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:32.421741 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 709/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:33.330179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba00114-1c9d-4602-9198-98606eee1db9 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:33.330689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba00114-1c9d-4602-9198-98606eee1db9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:33.330689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba00114-1c9d-4602-9198-98606eee1db9 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:33.332070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:33.337055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc48c-cb9d-434a-b4be-7f1dfb69447d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:33.337500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc48c-cb9d-434a-b4be-7f1dfb69447d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:33.337641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc48c-cb9d-434a-b4be-7f1dfb69447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:33.394607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:33.416949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-87cfc48c-cb9d-434a-b4be-7f1dfb69447d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:33.418165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-87cfc48c-cb9d-434a-b4be-7f1dfb69447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:33.519224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:33.667365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba00114-1c9d-4602-9198-98606eee1db9 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:33.668936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4ba00114-1c9d-4602-9198-98606eee1db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:33.817669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba00114-1c9d-4602-9198-98606eee1db9 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:33.830411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:33.938239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabdc0e-a7ea-4dd0-a38f-dd7946011771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:33.938793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdc0e-a7ea-4dd0-a38f-dd7946011771 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:33.939092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdc0e-a7ea-4dd0-a38f-dd7946011771 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:33.939373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdc0e-a7ea-4dd0-a38f-dd7946011771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:33.940998 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6cabdc0e-a7ea-4dd0-a38f-dd7946011771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:34.032908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabdc0e-a7ea-4dd0-a38f-dd7946011771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:34.034500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabdc0e-a7ea-4dd0-a38f-dd7946011771 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:34.053276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 712/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:35.015376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55e0c1-8936-40e9-912e-89e990cfac31 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:35.015966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55e0c1-8936-40e9-912e-89e990cfac31 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:35.015966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55e0c1-8936-40e9-912e-89e990cfac31 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:35.017332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:35.022462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7bd7e-fc71-4651-8aae-65a9f4bb2c80 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:35.022922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7bd7e-fc71-4651-8aae-65a9f4bb2c80 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:35.023055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7bd7e-fc71-4651-8aae-65a9f4bb2c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:35.043536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:35.102574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-12f7bd7e-fc71-4651-8aae-65a9f4bb2c80 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:35.103830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-12f7bd7e-fc71-4651-8aae-65a9f4bb2c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:35.201952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:35.361513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55e0c1-8936-40e9-912e-89e990cfac31 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:35.363089 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2b55e0c1-8936-40e9-912e-89e990cfac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:35.474671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:35.514944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55e0c1-8936-40e9-912e-89e990cfac31 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:35.635514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf0ba6-f920-4415-9f5d-1036c8ebe772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:35.636123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf0ba6-f920-4415-9f5d-1036c8ebe772 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:35.636396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf0ba6-f920-4415-9f5d-1036c8ebe772 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:35.636662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf0ba6-f920-4415-9f5d-1036c8ebe772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:35.638278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ccbf0ba6-f920-4415-9f5d-1036c8ebe772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:35.727053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:35.741473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf0ba6-f920-4415-9f5d-1036c8ebe772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:35.743180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf0ba6-f920-4415-9f5d-1036c8ebe772 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:35.761420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 712/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:36.637950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1e92d-0d46-49e6-91f3-f52069b35624 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:36.638497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1e92d-0d46-49e6-91f3-f52069b35624 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:36.638497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1e92d-0d46-49e6-91f3-f52069b35624 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:36.641200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:39:36.647992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94f234-02da-4092-ad49-77d07eb8d1c6 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:36.648611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94f234-02da-4092-ad49-77d07eb8d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:36.648611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94f234-02da-4092-ad49-77d07eb8d1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:36.724586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-bc94f234-02da-4092-ad49-77d07eb8d1c6 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:36.725846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bc94f234-02da-4092-ad49-77d07eb8d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:36.825361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:36.993008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1e92d-0d46-49e6-91f3-f52069b35624 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:36.994596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-daf1e92d-0d46-49e6-91f3-f52069b35624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:37.080505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:37.145529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1e92d-0d46-49e6-91f3-f52069b35624 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:37.262534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4c3d4-11b7-46b1-ab8c-3f81dba7f3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:37.263087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4c3d4-11b7-46b1-ab8c-3f81dba7f3f5 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:37.263370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4c3d4-11b7-46b1-ab8c-3f81dba7f3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:37.263643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4c3d4-11b7-46b1-ab8c-3f81dba7f3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:37.266336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-38d4c3d4-11b7-46b1-ab8c-3f81dba7f3f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:37.335725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:37.382751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4c3d4-11b7-46b1-ab8c-3f81dba7f3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:37.384376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4c3d4-11b7-46b1-ab8c-3f81dba7f3f5 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:37.404293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 715/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:38.258068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6859ab0-6338-45e6-be2c-b1dc6aadaa95 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.258919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6859ab0-6338-45e6-be2c-b1dc6aadaa95 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.259112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6859ab0-6338-45e6-be2c-b1dc6aadaa95 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.260698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:38.266305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9fd8-03c3-4520-b4eb-f146ec85e702 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.266746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9fd8-03c3-4520-b4eb-f146ec85e702 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.266884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9fd8-03c3-4520-b4eb-f146ec85e702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.349412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-52cb9fd8-03c3-4520-b4eb-f146ec85e702 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:38.350719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-52cb9fd8-03c3-4520-b4eb-f146ec85e702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:38.452102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:38.614961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6859ab0-6338-45e6-be2c-b1dc6aadaa95 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:38.616577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f6859ab0-6338-45e6-be2c-b1dc6aadaa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:38.673435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:38.774017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6859ab0-6338-45e6-be2c-b1dc6aadaa95 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:38.891877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7cbab-7b53-47c7-babf-81a38f0a2368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:38.892529 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7cbab-7b53-47c7-babf-81a38f0a2368 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:38.892802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7cbab-7b53-47c7-babf-81a38f0a2368 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:38.893066 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7cbab-7b53-47c7-babf-81a38f0a2368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:38.894659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ecb7cbab-7b53-47c7-babf-81a38f0a2368 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:38.901888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:38.996861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7cbab-7b53-47c7-babf-81a38f0a2368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:38.999145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7cbab-7b53-47c7-babf-81a38f0a2368 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:39.017130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 715/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:39.818326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2fcb-1c2e-4508-80e8-bc1fe582e935 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:39.818903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2fcb-1c2e-4508-80e8-bc1fe582e935 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:39.818903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2fcb-1c2e-4508-80e8-bc1fe582e935 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:39.820340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:39.825328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2ef5a-e090-47ea-869b-4ab0dbd6a9bc None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:39.825746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2ef5a-e090-47ea-869b-4ab0dbd6a9bc None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:39.825886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2ef5a-e090-47ea-869b-4ab0dbd6a9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:39.907232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4fe2ef5a-e090-47ea-869b-4ab0dbd6a9bc None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:39.908451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4fe2ef5a-e090-47ea-869b-4ab0dbd6a9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:39.984378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:40.014784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:40.171191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a2fcb-1c2e-4508-80e8-bc1fe582e935 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:40.172725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0c7a2fcb-1c2e-4508-80e8-bc1fe582e935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:40.190464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:40.326631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a2fcb-1c2e-4508-80e8-bc1fe582e935 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:40.416407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:40.443730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de225c-5cce-4daf-aa3f-af5d06699d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:40.444242 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de225c-5cce-4daf-aa3f-af5d06699d58 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:40.444519 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de225c-5cce-4daf-aa3f-af5d06699d58 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:40.444789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de225c-5cce-4daf-aa3f-af5d06699d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:40.446394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-25de225c-5cce-4daf-aa3f-af5d06699d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:40.539972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de225c-5cce-4daf-aa3f-af5d06699d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:40.541575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de225c-5cce-4daf-aa3f-af5d06699d58 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:40.559772 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 718/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:41.366209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56e5d5-8d8d-498f-996d-fb4e2fb07f5f None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:41.366787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56e5d5-8d8d-498f-996d-fb4e2fb07f5f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:41.366787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56e5d5-8d8d-498f-996d-fb4e2fb07f5f None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:41.368195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:41.373164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6511a-0511-48fc-8d38-b8ec7c3b5294 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:41.373748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6511a-0511-48fc-8d38-b8ec7c3b5294 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:41.373748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6511a-0511-48fc-8d38-b8ec7c3b5294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:41.454340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-18e6511a-0511-48fc-8d38-b8ec7c3b5294 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:41.456028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-18e6511a-0511-48fc-8d38-b8ec7c3b5294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:41.498212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:41.554710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:41.715927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56e5d5-8d8d-498f-996d-fb4e2fb07f5f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:41.717566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1c56e5d5-8d8d-498f-996d-fb4e2fb07f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:41.864805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56e5d5-8d8d-498f-996d-fb4e2fb07f5f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:41.921000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:41.991167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79b0a7-baa5-43e3-a72f-ae2e6879c39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:41.991775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79b0a7-baa5-43e3-a72f-ae2e6879c39e service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:41.992110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79b0a7-baa5-43e3-a72f-ae2e6879c39e service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:41.992518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79b0a7-baa5-43e3-a72f-ae2e6879c39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:41.994320 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cd79b0a7-baa5-43e3-a72f-ae2e6879c39e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:42.083959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79b0a7-baa5-43e3-a72f-ae2e6879c39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:42.085559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79b0a7-baa5-43e3-a72f-ae2e6879c39e service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:42.103602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 718/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:42.927041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a3d54-a93f-48a0-ad4b-c20cf314ce31 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:42.927616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a3d54-a93f-48a0-ad4b-c20cf314ce31 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:42.927728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a3d54-a93f-48a0-ad4b-c20cf314ce31 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:42.929048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:42.934047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29f15-8b19-42a2-8bf2-f1c528b09187 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:42.934495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29f15-8b19-42a2-8bf2-f1c528b09187 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:42.934602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29f15-8b19-42a2-8bf2-f1c528b09187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.018205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d4f29f15-8b19-42a2-8bf2-f1c528b09187 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:43.019455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d4f29f15-8b19-42a2-8bf2-f1c528b09187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:43.021476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:43.116782 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:43.265358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a3d54-a93f-48a0-ad4b-c20cf314ce31 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:43.266870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a00a3d54-a93f-48a0-ad4b-c20cf314ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:43.417476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a3d54-a93f-48a0-ad4b-c20cf314ce31 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:43.444724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:43.531844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b140a6-6198-4d19-a7e5-af634973f32a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:43.532362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b140a6-6198-4d19-a7e5-af634973f32a service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:43.532636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b140a6-6198-4d19-a7e5-af634973f32a service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:43.532905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b140a6-6198-4d19-a7e5-af634973f32a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:43.534480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-25b140a6-6198-4d19-a7e5-af634973f32a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:43.628486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b140a6-6198-4d19-a7e5-af634973f32a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:43.630364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b140a6-6198-4d19-a7e5-af634973f32a service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:43.649343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 721/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:45.532320 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219ca1-7556-465e-91b5-a66b0f3c7a8d None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.533010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219ca1-7556-465e-91b5-a66b0f3c7a8d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.533010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219ca1-7556-465e-91b5-a66b0f3c7a8d None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.534195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:45.539647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a84f4-ce5a-41a3-9241-84a517969751 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:45.540096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a84f4-ce5a-41a3-9241-84a517969751 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:45.540194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a84f4-ce5a-41a3-9241-84a517969751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:45.583449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:45.609930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-597a84f4-ce5a-41a3-9241-84a517969751 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:45.611166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-597a84f4-ce5a-41a3-9241-84a517969751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:45.714263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:45.996943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219ca1-7556-465e-91b5-a66b0f3c7a8d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:45.999021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ef219ca1-7556-465e-91b5-a66b0f3c7a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:46.100700 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219ca1-7556-465e-91b5-a66b0f3c7a8d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:46.133239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:46.176898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb5b35-0a0d-406f-899a-d8c91e307040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:46.177564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb5b35-0a0d-406f-899a-d8c91e307040 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:46.177853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb5b35-0a0d-406f-899a-d8c91e307040 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:46.178128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb5b35-0a0d-406f-899a-d8c91e307040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:46.179768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-03eb5b35-0a0d-406f-899a-d8c91e307040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:46.294353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb5b35-0a0d-406f-899a-d8c91e307040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:46.296385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb5b35-0a0d-406f-899a-d8c91e307040 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:46.314212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 721/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:48.453178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7d150-c8cc-468c-a57e-707cc473fabf None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:48.453744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7d150-c8cc-468c-a57e-707cc473fabf None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:48.453744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7d150-c8cc-468c-a57e-707cc473fabf None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:48.455110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:48.460330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626e696-5282-4379-918f-4e02d0da6901 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:48.460763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626e696-5282-4379-918f-4e02d0da6901 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:48.460878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626e696-5282-4379-918f-4e02d0da6901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:48.527578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-8626e696-5282-4379-918f-4e02d0da6901 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:48.528802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8626e696-5282-4379-918f-4e02d0da6901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:48.542145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:48.632000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:48.939644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7d150-c8cc-468c-a57e-707cc473fabf None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:48.941434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-91e7d150-c8cc-468c-a57e-707cc473fabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:49.053719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7d150-c8cc-468c-a57e-707cc473fabf None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:49.067657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:49.141871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee20c6a-6b5e-46e7-beb3-592a743fd2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:49.142528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee20c6a-6b5e-46e7-beb3-592a743fd2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:49.142837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee20c6a-6b5e-46e7-beb3-592a743fd2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:49.143134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee20c6a-6b5e-46e7-beb3-592a743fd2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:49.144823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-2ee20c6a-6b5e-46e7-beb3-592a743fd2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:49.257869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee20c6a-6b5e-46e7-beb3-592a743fd2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:49.259279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee20c6a-6b5e-46e7-beb3-592a743fd2a6 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:49.278567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 724/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:39:51.562136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7cf03-f687-4ce5-b5a4-d46f34f0453a None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:51.562695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7cf03-f687-4ce5-b5a4-d46f34f0453a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:51.562695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7cf03-f687-4ce5-b5a4-d46f34f0453a None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:51.564049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:51.569499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e53328-2d37-49ab-b1e3-c1e35e292387 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:51.569966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e53328-2d37-49ab-b1e3-c1e35e292387 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:51.570157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e53328-2d37-49ab-b1e3-c1e35e292387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:51.621844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:51.641617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d7e53328-2d37-49ab-b1e3-c1e35e292387 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:51.642876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d7e53328-2d37-49ab-b1e3-c1e35e292387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:51.743346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:52.040147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7cf03-f687-4ce5-b5a4-d46f34f0453a None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:52.041695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9ad7cf03-f687-4ce5-b5a4-d46f34f0453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:52.147324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7cf03-f687-4ce5-b5a4-d46f34f0453a None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:52.187015 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:52.222516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb5ec-a25e-43a5-873e-1d4db158dd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:52.223156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb5ec-a25e-43a5-873e-1d4db158dd7c service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:52.223442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb5ec-a25e-43a5-873e-1d4db158dd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:52.223716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb5ec-a25e-43a5-873e-1d4db158dd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:52.225475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-55cdb5ec-a25e-43a5-873e-1d4db158dd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:52.341765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdb5ec-a25e-43a5-873e-1d4db158dd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:52.343745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdb5ec-a25e-43a5-873e-1d4db158dd7c service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:52.361750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 724/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:54.506859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8b8bd-180c-4ca5-a3d4-2fd64d3f3448 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:54.507422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8b8bd-180c-4ca5-a3d4-2fd64d3f3448 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:54.507422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8b8bd-180c-4ca5-a3d4-2fd64d3f3448 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:54.508760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:54.514831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1412-6a4a-4c39-bfb0-0e1068e884f9 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:54.515247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1412-6a4a-4c39-bfb0-0e1068e884f9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:54.515476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1412-6a4a-4c39-bfb0-0e1068e884f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:54.581314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-950b1412-6a4a-4c39-bfb0-0e1068e884f9 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:54.582546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-950b1412-6a4a-4c39-bfb0-0e1068e884f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:54.602966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:54.681603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:39:54.966351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8b8bd-180c-4ca5-a3d4-2fd64d3f3448 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:54.968387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b5b8b8bd-180c-4ca5-a3d4-2fd64d3f3448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:55.076722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8b8bd-180c-4ca5-a3d4-2fd64d3f3448 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:55.098080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:55.153855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc42ce-2c1a-4e5f-b46d-ecdfc110d63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:55.154463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc42ce-2c1a-4e5f-b46d-ecdfc110d63f service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:55.154747 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc42ce-2c1a-4e5f-b46d-ecdfc110d63f service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:55.156130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc42ce-2c1a-4e5f-b46d-ecdfc110d63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:55.157751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-57dc42ce-2c1a-4e5f-b46d-ecdfc110d63f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:55.270375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc42ce-2c1a-4e5f-b46d-ecdfc110d63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:55.271755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc42ce-2c1a-4e5f-b46d-ecdfc110d63f service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:55.290686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 727/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:39:57.299894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc0093-626d-47dd-aaf7-aa1e6d1d3662 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.300425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc0093-626d-47dd-aaf7-aa1e6d1d3662 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.300425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc0093-626d-47dd-aaf7-aa1e6d1d3662 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.301700 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:39:57.307081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23311b4-e4d7-4c08-8d6f-e28d9f32ea29 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.307477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23311b4-e4d7-4c08-8d6f-e28d9f32ea29 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.307627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23311b4-e4d7-4c08-8d6f-e28d9f32ea29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.375686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:57.378457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d23311b4-e4d7-4c08-8d6f-e28d9f32ea29 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:39:57.380250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d23311b4-e4d7-4c08-8d6f-e28d9f32ea29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:57.482526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:39:57.771450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc0093-626d-47dd-aaf7-aa1e6d1d3662 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:39:57.773050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c9bc0093-626d-47dd-aaf7-aa1e6d1d3662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:57.909906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc0093-626d-47dd-aaf7-aa1e6d1d3662 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:39:57.969947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:57.995028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3483b97-ebf6-4b44-a554-ec1d50917b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:39:57.995634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3483b97-ebf6-4b44-a554-ec1d50917b0a service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:39:57.995915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3483b97-ebf6-4b44-a554-ec1d50917b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:39:57.996189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3483b97-ebf6-4b44-a554-ec1d50917b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:39:57.997781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e3483b97-ebf6-4b44-a554-ec1d50917b0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:39:58.110155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3483b97-ebf6-4b44-a554-ec1d50917b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:39:58.111556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3483b97-ebf6-4b44-a554-ec1d50917b0a service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:39:58.129850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 727/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:00.138044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7152fff-c820-4a05-94ac-ef063f7252b5 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:00.138573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7152fff-c820-4a05-94ac-ef063f7252b5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:00.138573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7152fff-c820-4a05-94ac-ef063f7252b5 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:00.140539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:00.146097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fc6cb-a255-42aa-89bd-2b0cde954400 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:00.146547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fc6cb-a255-42aa-89bd-2b0cde954400 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:00.146737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fc6cb-a255-42aa-89bd-2b0cde954400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:00.212762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-279fc6cb-a255-42aa-89bd-2b0cde954400 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:00.214238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-279fc6cb-a255-42aa-89bd-2b0cde954400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:00.245671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:00.317520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:00.607123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7152fff-c820-4a05-94ac-ef063f7252b5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:00.608880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b7152fff-c820-4a05-94ac-ef063f7252b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:00.731102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7152fff-c820-4a05-94ac-ef063f7252b5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:00.764682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:00.818038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3df42-8f5e-491e-95db-7a6bd85348fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:00.818701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3df42-8f5e-491e-95db-7a6bd85348fd service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:00.819024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3df42-8f5e-491e-95db-7a6bd85348fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:00.819300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3df42-8f5e-491e-95db-7a6bd85348fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:00.821151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8bc3df42-8f5e-491e-95db-7a6bd85348fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:00.948756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3df42-8f5e-491e-95db-7a6bd85348fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:00.950229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3df42-8f5e-491e-95db-7a6bd85348fd service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:00.974014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 730/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:40:02.995898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb03ae-471b-4282-b47a-bf1bb0f3087f None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:02.996448 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb03ae-471b-4282-b47a-bf1bb0f3087f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:02.996448 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb03ae-471b-4282-b47a-bf1bb0f3087f None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:02.997949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:03.004198 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925a54-da4d-4bbb-9c57-2c834172e360 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:03.004679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925a54-da4d-4bbb-9c57-2c834172e360 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:03.004774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16925a54-da4d-4bbb-9c57-2c834172e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:03.073411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-16925a54-da4d-4bbb-9c57-2c834172e360 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:03.074636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-16925a54-da4d-4bbb-9c57-2c834172e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:03.083446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:03.175781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:03.472616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb03ae-471b-4282-b47a-bf1bb0f3087f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:03.474322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d7cb03ae-471b-4282-b47a-bf1bb0f3087f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:03.578740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb03ae-471b-4282-b47a-bf1bb0f3087f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:03.635847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:03.654994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538c00b-39a7-4794-9588-86bdad995a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:03.655947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538c00b-39a7-4794-9588-86bdad995a32 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:03.656230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538c00b-39a7-4794-9588-86bdad995a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:03.656506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538c00b-39a7-4794-9588-86bdad995a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:03.658143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-0538c00b-39a7-4794-9588-86bdad995a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:03.771424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538c00b-39a7-4794-9588-86bdad995a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:03.772792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538c00b-39a7-4794-9588-86bdad995a32 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:03.791095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 730/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:05.779489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a72bee-a5ff-4812-adef-710bf9aac3ec None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:05.780505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a72bee-a5ff-4812-adef-710bf9aac3ec None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:05.780505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a72bee-a5ff-4812-adef-710bf9aac3ec None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:05.781996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:05.787478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87e7a9-95ea-45b8-955d-9764d831b29f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:05.787913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87e7a9-95ea-45b8-955d-9764d831b29f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:05.788027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87e7a9-95ea-45b8-955d-9764d831b29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:05.860027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-7a87e7a9-95ea-45b8-955d-9764d831b29f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:05.861286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7a87e7a9-95ea-45b8-955d-9764d831b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:05.901612 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:05.961303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:06.245446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a72bee-a5ff-4812-adef-710bf9aac3ec None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:06.247061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a3a72bee-a5ff-4812-adef-710bf9aac3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:06.355290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a72bee-a5ff-4812-adef-710bf9aac3ec None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:06.397542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:06.434677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075fed9-300b-4984-824a-69cc21ef8220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:06.435317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075fed9-300b-4984-824a-69cc21ef8220 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:06.435601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075fed9-300b-4984-824a-69cc21ef8220 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:06.435876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075fed9-300b-4984-824a-69cc21ef8220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:06.438177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8075fed9-300b-4984-824a-69cc21ef8220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:06.556413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075fed9-300b-4984-824a-69cc21ef8220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:06.557768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075fed9-300b-4984-824a-69cc21ef8220 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:06.576450 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 733/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:08.536434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18193e0d-69d9-48d5-acd3-756f65c7c4cf None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.537036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18193e0d-69d9-48d5-acd3-756f65c7c4cf None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.537036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18193e0d-69d9-48d5-acd3-756f65c7c4cf None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.538345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:08.543807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141bd4-6a48-45b2-baaf-0fd71269fab5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:08.544262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141bd4-6a48-45b2-baaf-0fd71269fab5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:08.544368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141bd4-6a48-45b2-baaf-0fd71269fab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:08.614306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-87141bd4-6a48-45b2-baaf-0fd71269fab5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:08.615596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-87141bd4-6a48-45b2-baaf-0fd71269fab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:08.633476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:08.723523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:09.023528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18193e0d-69d9-48d5-acd3-756f65c7c4cf None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:09.025107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-18193e0d-69d9-48d5-acd3-756f65c7c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:09.129510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18193e0d-69d9-48d5-acd3-756f65c7c4cf None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:09.196134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:09.203737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fefbf4-92e6-4e22-9bfa-5e5ac6bf2d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:09.204353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fefbf4-92e6-4e22-9bfa-5e5ac6bf2d55 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:09.204637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fefbf4-92e6-4e22-9bfa-5e5ac6bf2d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:09.204911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fefbf4-92e6-4e22-9bfa-5e5ac6bf2d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:09.206578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-25fefbf4-92e6-4e22-9bfa-5e5ac6bf2d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:09.317606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fefbf4-92e6-4e22-9bfa-5e5ac6bf2d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:09.319068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fefbf4-92e6-4e22-9bfa-5e5ac6bf2d55 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:09.337272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 733/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:11.342385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b8ce-a01a-47d0-b23d-e77e2cfdffac None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.343155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b8ce-a01a-47d0-b23d-e77e2cfdffac None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.343155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b8ce-a01a-47d0-b23d-e77e2cfdffac None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.344417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:11.350042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cd857-f5ae-4736-a881-4356555c6204 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:11.350481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cd857-f5ae-4736-a881-4356555c6204 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:11.350605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cd857-f5ae-4736-a881-4356555c6204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:11.423696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5c0cd857-f5ae-4736-a881-4356555c6204 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:11.424964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5c0cd857-f5ae-4736-a881-4356555c6204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.474201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:11.524197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:11.843355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b8ce-a01a-47d0-b23d-e77e2cfdffac None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:11.845174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e8b4b8ce-a01a-47d0-b23d-e77e2cfdffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:11.954541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b8ce-a01a-47d0-b23d-e77e2cfdffac None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:12.009152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:12.037910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d7220-fd6a-4ab6-a996-d01b6bdadc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:12.038523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d7220-fd6a-4ab6-a996-d01b6bdadc46 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:12.038828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d7220-fd6a-4ab6-a996-d01b6bdadc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:12.039103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d7220-fd6a-4ab6-a996-d01b6bdadc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:12.040897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a72d7220-fd6a-4ab6-a996-d01b6bdadc46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:12.154013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d7220-fd6a-4ab6-a996-d01b6bdadc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:12.156067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d7220-fd6a-4ab6-a996-d01b6bdadc46 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:12.175363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 736/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:21.522407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=22 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:22.172901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=66 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:32.136762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9419-d4be-4665-b0f5-12ed5bd0f480 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:32.137323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9419-d4be-4665-b0f5-12ed5bd0f480 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:32.137323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa9419-d4be-4665-b0f5-12ed5bd0f480 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:32.138653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 735/1471] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:32.144722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4842d-f6b9-47dd-8227-838174c9e7f5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:32.145173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4842d-f6b9-47dd-8227-838174c9e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:32.145276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4842d-f6b9-47dd-8227-838174c9e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:32.210861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-eed4842d-f6b9-47dd-8227-838174c9e7f5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:32.212018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-eed4842d-f6b9-47dd-8227-838174c9e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:32.313096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 737/1472] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:40:32.610569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a83d46-9a31-4186-8696-78b1e35d1722 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:32.610875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a83d46-9a31-4186-8696-78b1e35d1722 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:32.611150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a83d46-9a31-4186-8696-78b1e35d1722 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:32.612523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 736/1473] 10.222.0.59 () {54 vars in 967 bytes} [Wed Aug 24 11:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:32.617328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa3bdb-440f-480d-8385-76fd329d2b50 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:32.617601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa3bdb-440f-480d-8385-76fd329d2b50 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:32.617868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa3bdb-440f-480d-8385-76fd329d2b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:32.697953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-1daa3bdb-440f-480d-8385-76fd329d2b50 None None] MFA Rules not processed for user `bd3bd33cac7d4715bede59def04cdb92`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:32.699194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1daa3bdb-440f-480d-8385-76fd329d2b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:32.720103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:32.776209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 738/1474] 10.222.0.59 () {58 vars in 1064 bytes} [Wed Aug 24 11:40:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:32.785051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a83d46-9a31-4186-8696-78b1e35d1722 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:32.787719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a4a83d46-9a31-4186-8696-78b1e35d1722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:32.897993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a83d46-9a31-4186-8696-78b1e35d1722 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:32.973491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9251efc-968b-4ef9-bb7e-93f66e83501b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3bd33cac7d4715bede59def04cdb92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:32.974107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251efc-968b-4ef9-bb7e-93f66e83501b service glance] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:32.974383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251efc-968b-4ef9-bb7e-93f66e83501b service glance] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:32.974653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251efc-968b-4ef9-bb7e-93f66e83501b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:32.976283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d9251efc-968b-4ef9-bb7e-93f66e83501b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:33.032324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:33.089799 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9251efc-968b-4ef9-bb7e-93f66e83501b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:33.091293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9251efc-968b-4ef9-bb7e-93f66e83501b service glance] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:33.110291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 737/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:35.098750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03429252-ebfd-49f4-91c1-92c04919683c None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:35.099331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03429252-ebfd-49f4-91c1-92c04919683c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:35.099430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03429252-ebfd-49f4-91c1-92c04919683c None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:35.100755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 739/1476] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:35.106055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4680942-541f-4777-994d-ba2bdd714ba6 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:35.106480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4680942-541f-4777-994d-ba2bdd714ba6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:35.106587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4680942-541f-4777-994d-ba2bdd714ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:35.174391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d4680942-541f-4777-994d-ba2bdd714ba6 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:35.175647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d4680942-541f-4777-994d-ba2bdd714ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:35.274625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 738/1477] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:35.551267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03429252-ebfd-49f4-91c1-92c04919683c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:35.552748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-03429252-ebfd-49f4-91c1-92c04919683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:35.703907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03429252-ebfd-49f4-91c1-92c04919683c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:35.755844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:35.804755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf957a5-c87f-49be-9269-eda0e081aeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:35.805266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf957a5-c87f-49be-9269-eda0e081aeed admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:35.805552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf957a5-c87f-49be-9269-eda0e081aeed admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:35.805827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf957a5-c87f-49be-9269-eda0e081aeed admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:35.806463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf957a5-c87f-49be-9269-eda0e081aeed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:35.808303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WARNING py.warnings [None req-eaf957a5-c87f-49be-9269-eda0e081aeed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:40:35.808303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: warnings.warn(msg) Aug 24 11:40:35.808303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: Aug 24 11:40:35.809449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf957a5-c87f-49be-9269-eda0e081aeed admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:35.828407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 740/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 11:40:35 2022] GET /identity/v3/projects => generated 2553 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:40:37.815424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1813c-506d-409f-bb99-57416d287e63 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:37.815936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1813c-506d-409f-bb99-57416d287e63 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:37.815936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1813c-506d-409f-bb99-57416d287e63 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:37.817318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 739/1479] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:37.822687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1002d-6b4a-4cf4-9481-99c9bde61ad3 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:37.823168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1002d-6b4a-4cf4-9481-99c9bde61ad3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:37.823266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1002d-6b4a-4cf4-9481-99c9bde61ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:37.897914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6fb1002d-6b4a-4cf4-9481-99c9bde61ad3 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:37.899199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6fb1002d-6b4a-4cf4-9481-99c9bde61ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:38.010407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 741/1480] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:38.308575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1813c-506d-409f-bb99-57416d287e63 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:38.310324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-73c1813c-506d-409f-bb99-57416d287e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:38.321195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:38.460570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1813c-506d-409f-bb99-57416d287e63 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:38.541840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:38.578219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089f68d-e3ef-4987-8033-a135fe3d30a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:38.578219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f68d-e3ef-4987-8033-a135fe3d30a1 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:38.579051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f68d-e3ef-4987-8033-a135fe3d30a1 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:38.579329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f68d-e3ef-4987-8033-a135fe3d30a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:38.580975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f089f68d-e3ef-4987-8033-a135fe3d30a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:38.672335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089f68d-e3ef-4987-8033-a135fe3d30a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:38.673926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089f68d-e3ef-4987-8033-a135fe3d30a1 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:38.692413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 740/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:40.885547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589344e6-ab7f-48bd-962b-45ec3d49f45d None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:40.886161 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589344e6-ab7f-48bd-962b-45ec3d49f45d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:40.886161 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589344e6-ab7f-48bd-962b-45ec3d49f45d None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:40.887533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 742/1482] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:40.893730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1516-4dbf-4c04-821c-3d70dc425790 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:40.894170 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1516-4dbf-4c04-821c-3d70dc425790 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:40.894294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c1516-4dbf-4c04-821c-3d70dc425790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:40.970990 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-598c1516-4dbf-4c04-821c-3d70dc425790 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:40.972222 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-598c1516-4dbf-4c04-821c-3d70dc425790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:41.019682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:41.190224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 741/1483] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:41.479386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589344e6-ab7f-48bd-962b-45ec3d49f45d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:41.481007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-589344e6-ab7f-48bd-962b-45ec3d49f45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:41.506288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:41.589946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589344e6-ab7f-48bd-962b-45ec3d49f45d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:41.669610 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2a780-f697-401f-9663-0de24b94183b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:41.670271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2a780-f697-401f-9663-0de24b94183b service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:41.670552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2a780-f697-401f-9663-0de24b94183b service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:41.670847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2a780-f697-401f-9663-0de24b94183b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:41.673127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6bd2a780-f697-401f-9663-0de24b94183b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:41.748678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:41.784494 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2a780-f697-401f-9663-0de24b94183b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:41.785922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2a780-f697-401f-9663-0de24b94183b service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:41.804149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 743/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:43.802603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e4d4b-450e-4ee8-a167-c7642e9b3760 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.803206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e4d4b-450e-4ee8-a167-c7642e9b3760 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.803206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e4d4b-450e-4ee8-a167-c7642e9b3760 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.804412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 742/1485] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:43.809643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e3ea-49e4-49ed-8f9b-66864ff0c1c6 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:43.810093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e3ea-49e4-49ed-8f9b-66864ff0c1c6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:43.810190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e3ea-49e4-49ed-8f9b-66864ff0c1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:43.879468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-80f1e3ea-49e4-49ed-8f9b-66864ff0c1c6 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:43.880691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-80f1e3ea-49e4-49ed-8f9b-66864ff0c1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:43.978978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 744/1486] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:44.269216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e4d4b-450e-4ee8-a167-c7642e9b3760 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:44.270752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d55e4d4b-450e-4ee8-a167-c7642e9b3760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:44.385317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e4d4b-450e-4ee8-a167-c7642e9b3760 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:44.457198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:44.459155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84b5dd-b245-421c-b4c1-426fe90f8ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:44.459764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84b5dd-b245-421c-b4c1-426fe90f8ead service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:44.460234 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84b5dd-b245-421c-b4c1-426fe90f8ead service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:44.460561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84b5dd-b245-421c-b4c1-426fe90f8ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:44.462527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bf84b5dd-b245-421c-b4c1-426fe90f8ead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:44.570896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84b5dd-b245-421c-b4c1-426fe90f8ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:44.572253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84b5dd-b245-421c-b4c1-426fe90f8ead service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:44.591401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 743/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:46.655255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c6226-4cea-48f8-9c70-1979bbbd26c5 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:46.656013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c6226-4cea-48f8-9c70-1979bbbd26c5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:46.656013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c6226-4cea-48f8-9c70-1979bbbd26c5 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:46.657149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 745/1488] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:46.662667 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecac2-a05a-41d1-baee-77d677670c24 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:46.663113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecac2-a05a-41d1-baee-77d677670c24 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:46.663263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecac2-a05a-41d1-baee-77d677670c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:46.729369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-42cecac2-a05a-41d1-baee-77d677670c24 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:46.730654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-42cecac2-a05a-41d1-baee-77d677670c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:46.783197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:46.828781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 744/1489] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:47.125609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c6226-4cea-48f8-9c70-1979bbbd26c5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:47.127172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a37c6226-4cea-48f8-9c70-1979bbbd26c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:47.163554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:47.236314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c6226-4cea-48f8-9c70-1979bbbd26c5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:47.311124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7d53b-4ce0-4bfe-aaf9-2cc53905dd04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:47.311957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7d53b-4ce0-4bfe-aaf9-2cc53905dd04 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:47.312472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7d53b-4ce0-4bfe-aaf9-2cc53905dd04 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:47.312764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7d53b-4ce0-4bfe-aaf9-2cc53905dd04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:47.314487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b9a7d53b-4ce0-4bfe-aaf9-2cc53905dd04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:47.400308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:47.429889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7d53b-4ce0-4bfe-aaf9-2cc53905dd04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:47.431365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7d53b-4ce0-4bfe-aaf9-2cc53905dd04 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:47.449566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 746/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:49.557174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c4bb-6d3f-4510-9c5f-5a5bf151c41f None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:49.557755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c4bb-6d3f-4510-9c5f-5a5bf151c41f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:49.557755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c4bb-6d3f-4510-9c5f-5a5bf151c41f None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:49.559126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 745/1491] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 11:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:40:49.565008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda76ab-7414-4fbb-995d-12164a99743c None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:49.565484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda76ab-7414-4fbb-995d-12164a99743c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:49.565591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda76ab-7414-4fbb-995d-12164a99743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:49.634805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-7bda76ab-7414-4fbb-995d-12164a99743c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:40:49.636111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7bda76ab-7414-4fbb-995d-12164a99743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:49.735962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 747/1492] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 11:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:40:50.035756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c4bb-6d3f-4510-9c5f-5a5bf151c41f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:40:50.037308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f164c4bb-6d3f-4510-9c5f-5a5bf151c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:50.142814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c4bb-6d3f-4510-9c5f-5a5bf151c41f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:40:50.216037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dd0b8-9b90-4606-a331-2fe305d5d0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:40:50.216647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dd0b8-9b90-4606-a331-2fe305d5d0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:40:50.216929 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dd0b8-9b90-4606-a331-2fe305d5d0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:40:50.217202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dd0b8-9b90-4606-a331-2fe305d5d0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:40:50.219384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a13dd0b8-9b90-4606-a331-2fe305d5d0e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:40:50.228467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:50.331307 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dd0b8-9b90-4606-a331-2fe305d5d0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:40:50.332659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dd0b8-9b90-4606-a331-2fe305d5d0e6 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:40:50.350488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 746/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:40:59.734611 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=82 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:41:00.348215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=50 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:06.513252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac43a9-1884-4966-b55f-7bca23cb7bf6 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:06.513842 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac43a9-1884-4966-b55f-7bca23cb7bf6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:06.513842 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac43a9-1884-4966-b55f-7bca23cb7bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:06.591883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-85ac43a9-1884-4966-b55f-7bca23cb7bf6 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:42:06.593704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-85ac43a9-1884-4966-b55f-7bca23cb7bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:06.691598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 748/1494] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:42:06.699633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325500cb-37d8-460d-a019-af35d82340cd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:06.700151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325500cb-37d8-460d-a019-af35d82340cd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:06.700256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325500cb-37d8-460d-a019-af35d82340cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:06.775561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-325500cb-37d8-460d-a019-af35d82340cd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:42:06.776774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-325500cb-37d8-460d-a019-af35d82340cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:06.875504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 747/1495] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:42:06.880378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac43a9-1884-4966-b55f-7bca23cb7bf6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:06.881621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-85ac43a9-1884-4966-b55f-7bca23cb7bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:06.894122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac43a9-1884-4966-b55f-7bca23cb7bf6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:06.957690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:06.994602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:06.995241 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:06.995524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:06.995798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:06.996438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:42:06.996742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:06.997765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WARNING py.warnings [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:42:06.997765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: warnings.warn(msg) Aug 24 11:42:06.997765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: Aug 24 11:42:06.998674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:07.010956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 749/1496] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:42:07.020179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325500cb-37d8-460d-a019-af35d82340cd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:07.029366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325500cb-37d8-460d-a019-af35d82340cd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:07.095637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:07.132978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:07.133591 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:07.133878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:07.134153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:07.134795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:07.136833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WARNING py.warnings [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:42:07.136833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: warnings.warn(msg) Aug 24 11:42:07.136833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: Aug 24 11:42:07.138031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:07.200321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 748/1497] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:42:07 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:42:07.206444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:07.208244 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:07.244568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89009ec5-7313-4d79-a021-e135194544eb admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:07.344022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:07.344627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:07.344902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:07.345172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:07.345784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:07.346817 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WARNING py.warnings [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:42:07.346817 dv-cinder-846054-1-smb devstack@keystone.service[88086]: warnings.warn(msg) Aug 24 11:42:07.346817 dv-cinder-846054-1-smb devstack@keystone.service[88086]: Aug 24 11:42:07.348023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:07.392068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 750/1498] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:42:07 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:42:07.396158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:07.397732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:07.462252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f6b3-30b3-486d-87eb-e06804cf079b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:07.555262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:07.567933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:07.568548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:07.568826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:07.569098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:07.569740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:07.570745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WARNING py.warnings [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:42:07.570745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: warnings.warn(msg) Aug 24 11:42:07.570745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: Aug 24 11:42:07.571711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:07.585126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 749/1499] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:42:07.589263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:07.590796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:07.602046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596c244-c85f-4d2b-824b-34eee03ae1b1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:07.627866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:07.699808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65bbd0-f3bb-40ad-94ae-475c2e12a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:07.700419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65bbd0-f3bb-40ad-94ae-475c2e12a5cd admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:07.700706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65bbd0-f3bb-40ad-94ae-475c2e12a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:07.700979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65bbd0-f3bb-40ad-94ae-475c2e12a5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:07.701619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65bbd0-f3bb-40ad-94ae-475c2e12a5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:07.703478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WARNING py.warnings [None req-bd65bbd0-f3bb-40ad-94ae-475c2e12a5cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:42:07.703478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: warnings.warn(msg) Aug 24 11:42:07.703478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: Aug 24 11:42:07.704445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65bbd0-f3bb-40ad-94ae-475c2e12a5cd admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:07.717235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 751/1500] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:42:07.721572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:07.723124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:07.755864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670463d1-5c6f-42c8-8407-2e6feb0998e5 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:07.854884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08c08a-fa68-442b-9567-f9a8a5f4d4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:07.855647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08c08a-fa68-442b-9567-f9a8a5f4d4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:07.855928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08c08a-fa68-442b-9567-f9a8a5f4d4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:07.856203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08c08a-fa68-442b-9567-f9a8a5f4d4ba admin admin] PATH_INFO: `/v3/projects/08ad3318f73a4797afd9c19adb0ae419/users/253fb6045e31462f8d9602ef090a2ff2/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:07.885281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08c08a-fa68-442b-9567-f9a8a5f4d4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ad3318f73a4797afd9c19adb0ae419, user_id=253fb6045e31462f8d9602ef090a2ff2, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:07.886563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WARNING py.warnings [None req-3c08c08a-fa68-442b-9567-f9a8a5f4d4ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:42:07.886563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: warnings.warn(msg) Aug 24 11:42:07.886563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: Aug 24 11:42:07.888528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08c08a-fa68-442b-9567-f9a8a5f4d4ba admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:07.914141 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 750/1501] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:42:07 2022] PUT /identity/v3/projects/08ad3318f73a4797afd9c19adb0ae419/users/253fb6045e31462f8d9602ef090a2ff2/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:42:07.926342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0666f9-82c2-403f-8a5b-9b025d820b09 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:07.926624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0666f9-82c2-403f-8a5b-9b025d820b09 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:07.926949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0666f9-82c2-403f-8a5b-9b025d820b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:07.987851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-0f0666f9-82c2-403f-8a5b-9b025d820b09 None None] MFA Rules not processed for user `253fb6045e31462f8d9602ef090a2ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:42:07.988992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0f0666f9-82c2-403f-8a5b-9b025d820b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:08.070185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 752/1502] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:42:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:42:08.084102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338d887-435e-486c-baf0-71ca3b6e5b6b None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:08.084434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338d887-435e-486c-baf0-71ca3b6e5b6b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:08.084710 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338d887-435e-486c-baf0-71ca3b6e5b6b None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:08.086141 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 751/1503] 10.222.0.59 () {54 vars in 964 bytes} [Wed Aug 24 11:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:42:08.091944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445c4b-f8ec-4285-b08a-9852238c32cd None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:08.092234 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445c4b-f8ec-4285-b08a-9852238c32cd None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:08.092515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445c4b-f8ec-4285-b08a-9852238c32cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:08.124247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:08.292736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-5f445c4b-f8ec-4285-b08a-9852238c32cd None None] MFA Rules not processed for user `580a07e04f3e42a5bb2801e583a78a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:42:08.293889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5f445c4b-f8ec-4285-b08a-9852238c32cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:08.373693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 753/1504] 10.222.0.59 () {58 vars in 1061 bytes} [Wed Aug 24 11:42:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:42:08.382150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338d887-435e-486c-baf0-71ca3b6e5b6b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:08.383795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c338d887-435e-486c-baf0-71ca3b6e5b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:08.433357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:08.489134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338d887-435e-486c-baf0-71ca3b6e5b6b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:08.564582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:08.565109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:08.565391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:08.565663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:08.567311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:08.671997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:08.673610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:08.677220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:08.692954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 752/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:42:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:42:08.738617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605440bd-c245-477b-b487-fdbf820a2878 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:08.739080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605440bd-c245-477b-b487-fdbf820a2878 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:08.739208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605440bd-c245-477b-b487-fdbf820a2878 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:08.740720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 754/1506] 10.222.0.59 () {52 vars in 830 bytes} [Wed Aug 24 11:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:42:08.744329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:08.745543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:08.847494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483fa68-058a-4c11-903a-9ae0e1c0a34b service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:08.946712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:08.947382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:08.947657 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:08.947923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] PATH_INFO: `/v3/users/253fb6045e31462f8d9602ef090a2ff2` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:08.960838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253fb6045e31462f8d9602ef090a2ff2)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:08.961890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WARNING py.warnings [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:42:08.961890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: warnings.warn(msg) Aug 24 11:42:08.961890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: Aug 24 11:42:08.963196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:08.975881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:09.033484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253fb6045e31462f8d9602ef090a2ff2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:09.047462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253fb6045e31462f8d9602ef090a2ff2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:09.048017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253fb6045e31462f8d9602ef090a2ff2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:09.072770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253fb6045e31462f8d9602ef090a2ff2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:09.073239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253fb6045e31462f8d9602ef090a2ff2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:09.088329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 753/1507] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:42:08 2022] DELETE /identity/v3/users/253fb6045e31462f8d9602ef090a2ff2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:42:09.093415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a62b60-df32-434c-aabf-3574126c1d23 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:09.093780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a62b60-df32-434c-aabf-3574126c1d23 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:09.094111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a62b60-df32-434c-aabf-3574126c1d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:09.150696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d0a62b60-df32-434c-aabf-3574126c1d23 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:42:09.151949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d0a62b60-df32-434c-aabf-3574126c1d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:09.229108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:09.244589 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 755/1508] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:42:09.255311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:09.256532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:09.355143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598379-1262-4f0d-8458-148808384ca2 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:09.412480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:09.434918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2b134-daed-43a2-bf03-7d05a7fcaaf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:09.435538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2b134-daed-43a2-bf03-7d05a7fcaaf3 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:09.435822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2b134-daed-43a2-bf03-7d05a7fcaaf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:09.436096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2b134-daed-43a2-bf03-7d05a7fcaaf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:09.439417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6ea2b134-daed-43a2-bf03-7d05a7fcaaf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:09.552427 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2b134-daed-43a2-bf03-7d05a7fcaaf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:09.554033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2b134-daed-43a2-bf03-7d05a7fcaaf3 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:09.573476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 754/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:42:09.910592 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a62b60-df32-434c-aabf-3574126c1d23 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:42:09.912382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d0a62b60-df32-434c-aabf-3574126c1d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:42:09.925651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a62b60-df32-434c-aabf-3574126c1d23 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:42:10.032067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:42:10.032699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:42:10.032982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:42:10.033258 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] PATH_INFO: `/v3/projects/08ad3318f73a4797afd9c19adb0ae419` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:42:10.043550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ad3318f73a4797afd9c19adb0ae419)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:42:10.044591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WARNING py.warnings [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:42:10.044591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: warnings.warn(msg) Aug 24 11:42:10.044591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: Aug 24 11:42:10.045788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:42:10.107335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ad3318f73a4797afd9c19adb0ae419', 'request_id': 'req-9b6944e4-a094-4380-b74a-0b39b479fd96'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:10.124318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ad3318f73a4797afd9c19adb0ae419', 'request_id': 'req-9b6944e4-a094-4380-b74a-0b39b479fd96'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:10.130788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ad3318f73a4797afd9c19adb0ae419', 'request_id': 'req-9b6944e4-a094-4380-b74a-0b39b479fd96'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:10.157891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] The token cache is being invalidate because project 08ad3318f73a4797afd9c19adb0ae419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:42:10.158201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:10.158587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b6944e4-a094-4380-b74a-0b39b479fd96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:42:10.160012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 756/1510] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:42:09 2022] DELETE /identity/v3/projects/08ad3318f73a4797afd9c19adb0ae419 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:42:19.571019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=62 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:20.155183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:50.657345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070258-f119-42e1-af55-79322c8d4f28 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:50.657980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070258-f119-42e1-af55-79322c8d4f28 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:50.657980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070258-f119-42e1-af55-79322c8d4f28 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:50.659323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:43:50.664308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb5ae5-575c-42d5-96bd-93066703173c None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:50.664734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb5ae5-575c-42d5-96bd-93066703173c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:50.664840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb5ae5-575c-42d5-96bd-93066703173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:50.748616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-5dbb5ae5-575c-42d5-96bd-93066703173c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:43:50.749852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5dbb5ae5-575c-42d5-96bd-93066703173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:43:50.857092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:43:51.018545 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e070258-f119-42e1-af55-79322c8d4f28 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:43:51.020751 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8e070258-f119-42e1-af55-79322c8d4f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:43:51.141766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e070258-f119-42e1-af55-79322c8d4f28 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:43:51.147419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13254-aa6e-46aa-8eaf-0f6fffb51a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:43:51.148038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13254-aa6e-46aa-8eaf-0f6fffb51a44 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:51.148325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13254-aa6e-46aa-8eaf-0f6fffb51a44 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:51.148602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13254-aa6e-46aa-8eaf-0f6fffb51a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:51.157912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c13254-aa6e-46aa-8eaf-0f6fffb51a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:43:51.159594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c13254-aa6e-46aa-8eaf-0f6fffb51a44 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:43:51.170149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 756/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:43:52.011495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddadc9e-50bb-437c-ad71-eaf35c72d396 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:52.012053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddadc9e-50bb-437c-ad71-eaf35c72d396 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:52.012053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddadc9e-50bb-437c-ad71-eaf35c72d396 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:52.014194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:43:52.019063 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffea34-fd34-4f19-a58d-ee7272012e3b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:52.019491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffea34-fd34-4f19-a58d-ee7272012e3b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:52.019649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffea34-fd34-4f19-a58d-ee7272012e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:52.040351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d7ffea34-fd34-4f19-a58d-ee7272012e3b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:43:52.041571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d7ffea34-fd34-4f19-a58d-ee7272012e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:43:52.050012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:43:52.204275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddadc9e-50bb-437c-ad71-eaf35c72d396 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:43:52.224936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddadc9e-50bb-437c-ad71-eaf35c72d396 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:43:52.236100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679975e2-50c4-4b5f-9058-9bb86d08f453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:43:52.236713 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679975e2-50c4-4b5f-9058-9bb86d08f453 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:52.236997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679975e2-50c4-4b5f-9058-9bb86d08f453 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:52.237276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679975e2-50c4-4b5f-9058-9bb86d08f453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:52.247103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679975e2-50c4-4b5f-9058-9bb86d08f453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:43:52.249555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679975e2-50c4-4b5f-9058-9bb86d08f453 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:43:52.259859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 759/1516] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:43:52.594933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e9430-75a3-4735-a5ee-82da2b23bbf7 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:52.595131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e9430-75a3-4735-a5ee-82da2b23bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:52.595399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e9430-75a3-4735-a5ee-82da2b23bbf7 None None] PATH_INFO: `/v3` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:52.596729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 758/1517] 10.222.0.30 () {54 vars in 925 bytes} [Wed Aug 24 11:43:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:43:52.603224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe809-0bea-4404-875c-e5e371f139d8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:52.603515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe809-0bea-4404-875c-e5e371f139d8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:52.603795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe809-0bea-4404-875c-e5e371f139d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:52.664531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-cadfe809-0bea-4404-875c-e5e371f139d8 None None] MFA Rules not processed for user `1485acc3d3e649168b8a1c69d0bbf12f`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:43:52.665763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-cadfe809-0bea-4404-875c-e5e371f139d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:43:52.683638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:43:52.738868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 760/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 24 11:43:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:43:56.605588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1ee44-f795-4214-a3e2-b26017459cae None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:56.606113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1ee44-f795-4214-a3e2-b26017459cae None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:56.606113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1ee44-f795-4214-a3e2-b26017459cae None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:56.608257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 759/1519] 10.222.0.59 () {54 vars in 961 bytes} [Wed Aug 24 11:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:43:56.613436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccf064-a16a-4745-a19d-4a0d4c26eae9 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:56.613886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccf064-a16a-4745-a19d-4a0d4c26eae9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:56.614091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccf064-a16a-4745-a19d-4a0d4c26eae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:56.634362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-89ccf064-a16a-4745-a19d-4a0d4c26eae9 None None] MFA Rules not processed for user `1485acc3d3e649168b8a1c69d0bbf12f`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:43:56.635624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-89ccf064-a16a-4745-a19d-4a0d4c26eae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:43:56.644500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 761/1520] 10.222.0.59 () {58 vars in 1058 bytes} [Wed Aug 24 11:43:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:43:56.652312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1ee44-f795-4214-a3e2-b26017459cae None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:43:56.665658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1ee44-f795-4214-a3e2-b26017459cae None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:43:56.671177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2a76e-531c-44b2-aefc-88618f6ff210 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:43:56.671763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a76e-531c-44b2-aefc-88618f6ff210 service placement] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:43:56.672041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a76e-531c-44b2-aefc-88618f6ff210 service placement] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:43:56.672311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a76e-531c-44b2-aefc-88618f6ff210 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:43:56.680548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2a76e-531c-44b2-aefc-88618f6ff210 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:43:56.682105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2a76e-531c-44b2-aefc-88618f6ff210 service placement] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:43:56.692291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 760/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:43:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:44:03.485214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db531e4-f78b-4493-ac0b-69c92306c283 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:03.485805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db531e4-f78b-4493-ac0b-69c92306c283 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:03.485805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db531e4-f78b-4493-ac0b-69c92306c283 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:03.487197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:44:03.492030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a26a9-23e5-48b6-8424-2703d096a842 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:03.492434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a26a9-23e5-48b6-8424-2703d096a842 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:03.492573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a26a9-23e5-48b6-8424-2703d096a842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:03.511941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-779a26a9-23e5-48b6-8424-2703d096a842 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:44:03.514025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-779a26a9-23e5-48b6-8424-2703d096a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:44:03.521853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:44:03.679648 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db531e4-f78b-4493-ac0b-69c92306c283 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:44:03.694214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db531e4-f78b-4493-ac0b-69c92306c283 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:44:03.699557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14371d18-21cc-4825-8f0b-bdb34cd612a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:44:03.700664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371d18-21cc-4825-8f0b-bdb34cd612a5 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:03.701142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371d18-21cc-4825-8f0b-bdb34cd612a5 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:03.701497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371d18-21cc-4825-8f0b-bdb34cd612a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:03.709657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14371d18-21cc-4825-8f0b-bdb34cd612a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:44:03.711429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14371d18-21cc-4825-8f0b-bdb34cd612a5 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:44:03.721408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 763/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:44:04.571424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f578a-7cf3-4bf9-94fb-eb13a2ddd442 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:04.572293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f578a-7cf3-4bf9-94fb-eb13a2ddd442 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:04.572293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f578a-7cf3-4bf9-94fb-eb13a2ddd442 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:04.573857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 11:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:44:04.579567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8137c-3afd-4273-a5fb-32bd3228c301 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:04.580017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8137c-3afd-4273-a5fb-32bd3228c301 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:04.580127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8137c-3afd-4273-a5fb-32bd3228c301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:04.599926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4da8137c-3afd-4273-a5fb-32bd3228c301 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:44:04.601162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4da8137c-3afd-4273-a5fb-32bd3228c301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:44:04.609259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 11:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:44:04.768506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f578a-7cf3-4bf9-94fb-eb13a2ddd442 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:44:04.783025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f578a-7cf3-4bf9-94fb-eb13a2ddd442 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:44:04.788756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871bba4-bd8b-4ebb-a5bc-f164973259c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:44:04.789357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871bba4-bd8b-4ebb-a5bc-f164973259c7 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:04.789639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871bba4-bd8b-4ebb-a5bc-f164973259c7 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:04.789914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871bba4-bd8b-4ebb-a5bc-f164973259c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:04.798372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871bba4-bd8b-4ebb-a5bc-f164973259c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:44:04.800050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871bba4-bd8b-4ebb-a5bc-f164973259c7 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:44:04.810146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 763/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:44:08.767307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77885cd0-7f40-4802-a973-9c338352786d None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:08.767836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77885cd0-7f40-4802-a973-9c338352786d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:08.767933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77885cd0-7f40-4802-a973-9c338352786d None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:08.769218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:44:08.774421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27a6c2-c10d-4481-813d-19ca6f49d56a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:08.774907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27a6c2-c10d-4481-813d-19ca6f49d56a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:08.775006 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27a6c2-c10d-4481-813d-19ca6f49d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:08.804021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5c27a6c2-c10d-4481-813d-19ca6f49d56a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:44:08.805259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5c27a6c2-c10d-4481-813d-19ca6f49d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:44:08.813476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:44:09.096121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77885cd0-7f40-4802-a973-9c338352786d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:44:09.097829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-77885cd0-7f40-4802-a973-9c338352786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:44:09.187485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77885cd0-7f40-4802-a973-9c338352786d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:44:09.191060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a67046-d037-449e-8ae4-dadf3a90b4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:44:09.191667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a67046-d037-449e-8ae4-dadf3a90b4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:09.191944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a67046-d037-449e-8ae4-dadf3a90b4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:09.192211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a67046-d037-449e-8ae4-dadf3a90b4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:09.201749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a67046-d037-449e-8ae4-dadf3a90b4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:44:09.203110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a67046-d037-449e-8ae4-dadf3a90b4f4 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:44:09.212664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 766/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:44:11.140258 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749d614-89d7-4ede-8f77-adca461451e4 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:11.140791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749d614-89d7-4ede-8f77-adca461451e4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:11.141238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749d614-89d7-4ede-8f77-adca461451e4 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:11.143817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:44:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:44:11.149211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1884e-5e3c-472f-ae09-482d8cc0f91d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:11.149648 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1884e-5e3c-472f-ae09-482d8cc0f91d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:11.149760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1884e-5e3c-472f-ae09-482d8cc0f91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:11.172232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-cad1884e-5e3c-472f-ae09-482d8cc0f91d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:44:11.174384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-cad1884e-5e3c-472f-ae09-482d8cc0f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:44:11.185378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:44:11.492774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749d614-89d7-4ede-8f77-adca461451e4 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:44:11.505441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749d614-89d7-4ede-8f77-adca461451e4 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:44:11.509374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b690a7-9399-481e-b3d9-8281d6f55a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:44:11.510049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b690a7-9399-481e-b3d9-8281d6f55a9f service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:11.510372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b690a7-9399-481e-b3d9-8281d6f55a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:11.510634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b690a7-9399-481e-b3d9-8281d6f55a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:11.520194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b690a7-9399-481e-b3d9-8281d6f55a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:44:11.521612 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b690a7-9399-481e-b3d9-8281d6f55a9f service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:44:11.531593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 766/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:44:14.963542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb607d6-f2b0-4e86-bb83-22d9be0518d9 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:14.964064 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb607d6-f2b0-4e86-bb83-22d9be0518d9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:14.964167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb607d6-f2b0-4e86-bb83-22d9be0518d9 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:14.965458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:44:14.971709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98661-ba7a-4507-ae6e-16cc91085cae None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:14.972145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98661-ba7a-4507-ae6e-16cc91085cae None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:14.972256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98661-ba7a-4507-ae6e-16cc91085cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:14.991335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-9ff98661-ba7a-4507-ae6e-16cc91085cae None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:44:14.992546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9ff98661-ba7a-4507-ae6e-16cc91085cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:44:15.000922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:44:15.572354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb607d6-f2b0-4e86-bb83-22d9be0518d9 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:44:15.574058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-cdb607d6-f2b0-4e86-bb83-22d9be0518d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:44:15.642960 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:15.658229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb607d6-f2b0-4e86-bb83-22d9be0518d9 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:44:15.661824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ef996-50ed-4eea-807d-789e9a23e250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:44:15.662427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ef996-50ed-4eea-807d-789e9a23e250 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:15.662707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ef996-50ed-4eea-807d-789e9a23e250 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:15.663009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ef996-50ed-4eea-807d-789e9a23e250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:15.672434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ef996-50ed-4eea-807d-789e9a23e250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:44:15.673858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ef996-50ed-4eea-807d-789e9a23e250 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:44:15.683213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 769/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:44:17.649130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3454-9f72-4e2e-b060-38608b4ea1a6 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:17.649747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3454-9f72-4e2e-b060-38608b4ea1a6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:17.649747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c3454-9f72-4e2e-b060-38608b4ea1a6 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:17.651069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 11:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:44:17.656878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099eec-8c38-459c-9556-584300da6a0a None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:17.657345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099eec-8c38-459c-9556-584300da6a0a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:17.657452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099eec-8c38-459c-9556-584300da6a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:17.676587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d9099eec-8c38-459c-9556-584300da6a0a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:44:17.677780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d9099eec-8c38-459c-9556-584300da6a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:44:17.686060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 11:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:44:18.237028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3454-9f72-4e2e-b060-38608b4ea1a6 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:44:18.238739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-589c3454-9f72-4e2e-b060-38608b4ea1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:44:18.252944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c3454-9f72-4e2e-b060-38608b4ea1a6 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:44:18.256527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e0fb0-54b8-4793-bc2f-c85f5d512f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:44:18.257120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e0fb0-54b8-4793-bc2f-c85f5d512f07 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:44:18.257400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e0fb0-54b8-4793-bc2f-c85f5d512f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:44:18.257672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e0fb0-54b8-4793-bc2f-c85f5d512f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:44:18.267742 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e0fb0-54b8-4793-bc2f-c85f5d512f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:44:18.269170 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e0fb0-54b8-4793-bc2f-c85f5d512f07 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:44:18.278802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 769/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:44:27.671792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=11 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:28.274513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:50.819349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc383ad-460a-40b9-9d95-beac879989bc None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:50.830981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc383ad-460a-40b9-9d95-beac879989bc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:50.830981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc383ad-460a-40b9-9d95-beac879989bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:50.855203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-dfc383ad-460a-40b9-9d95-beac879989bc None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:50.856987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dfc383ad-460a-40b9-9d95-beac879989bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:50.869460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 771/1540] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:45:50.879681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aeb45-fed5-4b78-9384-ceb459608800 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:50.880288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aeb45-fed5-4b78-9384-ceb459608800 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:50.880288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aeb45-fed5-4b78-9384-ceb459608800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:50.910890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-a67aeb45-fed5-4b78-9384-ceb459608800 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:50.912839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a67aeb45-fed5-4b78-9384-ceb459608800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:50.926568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 770/1541] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:50.931775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc383ad-460a-40b9-9d95-beac879989bc None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:50.946233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc383ad-460a-40b9-9d95-beac879989bc None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:50.954082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43393-bbec-4827-8c62-8defa36aef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:50.954703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43393-bbec-4827-8c62-8defa36aef22 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:50.955010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43393-bbec-4827-8c62-8defa36aef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:50.955282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43393-bbec-4827-8c62-8defa36aef22 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:50.955934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43393-bbec-4827-8c62-8defa36aef22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:45:50.956232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43393-bbec-4827-8c62-8defa36aef22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:50.957896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43393-bbec-4827-8c62-8defa36aef22 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:50.976967 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 772/1542] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:45:50.985751 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67aeb45-fed5-4b78-9384-ceb459608800 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:50.996615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67aeb45-fed5-4b78-9384-ceb459608800 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.011032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66d5c-6efa-4b70-a748-d0c09d89265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.012256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66d5c-6efa-4b70-a748-d0c09d89265e admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.012541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66d5c-6efa-4b70-a748-d0c09d89265e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.012808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66d5c-6efa-4b70-a748-d0c09d89265e admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.013479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c66d5c-6efa-4b70-a748-d0c09d89265e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.015537 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c66d5c-6efa-4b70-a748-d0c09d89265e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.075650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 771/1543] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:50 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:51.080184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43393-bbec-4827-8c62-8defa36aef22 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.091666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43393-bbec-4827-8c62-8defa36aef22 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.180391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17850ea-7956-4c6a-9a71-16b44a2812fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.181030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17850ea-7956-4c6a-9a71-16b44a2812fa admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.181310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17850ea-7956-4c6a-9a71-16b44a2812fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.181582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17850ea-7956-4c6a-9a71-16b44a2812fa admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.182238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17850ea-7956-4c6a-9a71-16b44a2812fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.184350 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17850ea-7956-4c6a-9a71-16b44a2812fa admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.217022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 773/1544] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:51.221149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66d5c-6efa-4b70-a748-d0c09d89265e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.239891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66d5c-6efa-4b70-a748-d0c09d89265e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.244888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50401ce-8588-434c-9745-6146e5383ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.246639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50401ce-8588-434c-9745-6146e5383ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.246988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50401ce-8588-434c-9745-6146e5383ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.247265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50401ce-8588-434c-9745-6146e5383ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.247917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50401ce-8588-434c-9745-6146e5383ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.249538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50401ce-8588-434c-9745-6146e5383ac5 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.261609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 772/1545] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:51.266167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17850ea-7956-4c6a-9a71-16b44a2812fa admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.280777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17850ea-7956-4c6a-9a71-16b44a2812fa admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.290708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e61bb-5839-498f-b406-78c6a9fbae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.291357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e61bb-5839-498f-b406-78c6a9fbae57 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.291635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e61bb-5839-498f-b406-78c6a9fbae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.291906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e61bb-5839-498f-b406-78c6a9fbae57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.293116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e61bb-5839-498f-b406-78c6a9fbae57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.294735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e61bb-5839-498f-b406-78c6a9fbae57 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.308250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 774/1546] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:51.313513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50401ce-8588-434c-9745-6146e5383ac5 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.324070 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50401ce-8588-434c-9745-6146e5383ac5 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.335401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ca72d-7b06-47bf-a2ff-14e335811542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.336003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca72d-7b06-47bf-a2ff-14e335811542 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.336298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca72d-7b06-47bf-a2ff-14e335811542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.336543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca72d-7b06-47bf-a2ff-14e335811542 admin admin] PATH_INFO: `/v3/projects/c88b730834c148a785026ca77cfa2afb/users/2f4ede1576cf4669b3a3c46d30f62f73/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.340550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73302a-ec05-493a-8fd1-8bdec0604610 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.340830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73302a-ec05-493a-8fd1-8bdec0604610 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.341086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73302a-ec05-493a-8fd1-8bdec0604610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.381270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ca72d-7b06-47bf-a2ff-14e335811542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88b730834c148a785026ca77cfa2afb, user_id=2f4ede1576cf4669b3a3c46d30f62f73, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.384016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ca72d-7b06-47bf-a2ff-14e335811542 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.388111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-2a73302a-ec05-493a-8fd1-8bdec0604610 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.389751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-2a73302a-ec05-493a-8fd1-8bdec0604610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.401910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 775/1547] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.404094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76299-095f-4272-9471-c4552c770e6f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.410794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76299-095f-4272-9471-c4552c770e6f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.411005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 773/1548] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:51 2022] PUT /identity/v3/projects/c88b730834c148a785026ca77cfa2afb/users/2f4ede1576cf4669b3a3c46d30f62f73/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:45:51.411688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76299-095f-4272-9471-c4552c770e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.411813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e570e9-e1e0-4c75-b15e-99d48390d6bd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.412051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e570e9-e1e0-4c75-b15e-99d48390d6bd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.412331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e570e9-e1e0-4c75-b15e-99d48390d6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.442981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-8bf76299-095f-4272-9471-c4552c770e6f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.444569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8bf76299-095f-4272-9471-c4552c770e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.452244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b7e570e9-e1e0-4c75-b15e-99d48390d6bd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.453465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b7e570e9-e1e0-4c75-b15e-99d48390d6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.532250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 776/1549] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.533527 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949cb6a-b350-485b-b527-2f9da7243454 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.533813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949cb6a-b350-485b-b527-2f9da7243454 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.534086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949cb6a-b350-485b-b527-2f9da7243454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.559489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f949cb6a-b350-485b-b527-2f9da7243454 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.561039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f949cb6a-b350-485b-b527-2f9da7243454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.562691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 774/1550] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:45:51.564130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555e53-eccb-4426-ad96-6c97ea06b3f3 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.567017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555e53-eccb-4426-ad96-6c97ea06b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.567428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555e53-eccb-4426-ad96-6c97ea06b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.569984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 777/1551] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.571364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4582-38e6-4e23-83c9-c01f3ff65c39 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.571650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4582-38e6-4e23-83c9-c01f3ff65c39 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.571923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4582-38e6-4e23-83c9-c01f3ff65c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.592061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-20555e53-eccb-4426-ad96-6c97ea06b3f3 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.593207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-20555e53-eccb-4426-ad96-6c97ea06b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.593684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6a0d4582-38e6-4e23-83c9-c01f3ff65c39 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.594888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6a0d4582-38e6-4e23-83c9-c01f3ff65c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.601772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 775/1552] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.610354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 778/1553] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.610558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19917c87-779a-4f71-b940-a9db959fbc2d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.610558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19917c87-779a-4f71-b940-a9db959fbc2d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.610558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19917c87-779a-4f71-b940-a9db959fbc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.610857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441dc72-b2ac-4c0f-8e05-382c07e6f1a6 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.610857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441dc72-b2ac-4c0f-8e05-382c07e6f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.610857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441dc72-b2ac-4c0f-8e05-382c07e6f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.629329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-19917c87-779a-4f71-b940-a9db959fbc2d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.629994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-e441dc72-b2ac-4c0f-8e05-382c07e6f1a6 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.630560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-19917c87-779a-4f71-b940-a9db959fbc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.631207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e441dc72-b2ac-4c0f-8e05-382c07e6f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.640000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 776/1554] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.640730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 779/1555] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.641257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189a8a5-c06d-4cb2-b27e-530009633a16 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.641542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189a8a5-c06d-4cb2-b27e-530009633a16 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.641815 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189a8a5-c06d-4cb2-b27e-530009633a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.643031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228af128-a47d-4375-ac5f-f86905950704 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.643750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228af128-a47d-4375-ac5f-f86905950704 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.644202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228af128-a47d-4375-ac5f-f86905950704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.673825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f189a8a5-c06d-4cb2-b27e-530009633a16 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.675089 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f189a8a5-c06d-4cb2-b27e-530009633a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.676955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-228af128-a47d-4375-ac5f-f86905950704 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.678146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-228af128-a47d-4375-ac5f-f86905950704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.683729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 777/1556] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.684531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189a8a5-c06d-4cb2-b27e-530009633a16 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.685788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f189a8a5-c06d-4cb2-b27e-530009633a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.690097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 780/1557] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.691015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228af128-a47d-4375-ac5f-f86905950704 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.702022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228af128-a47d-4375-ac5f-f86905950704 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.707326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3ea98-7347-4c4f-bb23-f025a78689b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.707942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3ea98-7347-4c4f-bb23-f025a78689b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.708226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3ea98-7347-4c4f-bb23-f025a78689b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.708500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3ea98-7347-4c4f-bb23-f025a78689b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.709144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3ea98-7347-4c4f-bb23-f025a78689b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:45:51.709455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3ea98-7347-4c4f-bb23-f025a78689b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.711096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3ea98-7347-4c4f-bb23-f025a78689b2 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.723679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 781/1558] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:45:51.724998 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af3718-406f-4cec-b530-a912b8796bc1 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.725289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af3718-406f-4cec-b530-a912b8796bc1 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.725568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af3718-406f-4cec-b530-a912b8796bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.747395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a2af3718-406f-4cec-b530-a912b8796bc1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.748402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189a8a5-c06d-4cb2-b27e-530009633a16 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.748585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a2af3718-406f-4cec-b530-a912b8796bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.752555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59068665-bfca-44ab-a7a1-d04b0c6abe1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.753171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59068665-bfca-44ab-a7a1-d04b0c6abe1c service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.753456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59068665-bfca-44ab-a7a1-d04b0c6abe1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.753860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59068665-bfca-44ab-a7a1-d04b0c6abe1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.756442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 782/1559] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.757624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c819f7a-7dc5-479d-acbb-51559f253b5b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.757909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c819f7a-7dc5-479d-acbb-51559f253b5b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.758173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c819f7a-7dc5-479d-acbb-51559f253b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.765038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59068665-bfca-44ab-a7a1-d04b0c6abe1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.766541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59068665-bfca-44ab-a7a1-d04b0c6abe1c service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.772301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:51.777313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 778/1560] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:45:51.778862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a2b6-778b-471a-b4b3-38f110f0fd26 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.779155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a2b6-778b-471a-b4b3-38f110f0fd26 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.779432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a2b6-778b-471a-b4b3-38f110f0fd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.780243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-3c819f7a-7dc5-479d-acbb-51559f253b5b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.781483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3c819f7a-7dc5-479d-acbb-51559f253b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.790982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 783/1561] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.795958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e58b23-3a2d-4816-a413-b9a9bfca844b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.795958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e58b23-3a2d-4816-a413-b9a9bfca844b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.795958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e58b23-3a2d-4816-a413-b9a9bfca844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.802012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6366a2b6-778b-471a-b4b3-38f110f0fd26 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.803286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6366a2b6-778b-471a-b4b3-38f110f0fd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.812530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 779/1562] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.813487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366a2b6-778b-471a-b4b3-38f110f0fd26 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.816534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-e6e58b23-3a2d-4816-a413-b9a9bfca844b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.817992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e6e58b23-3a2d-4816-a413-b9a9bfca844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.819646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:51.824235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366a2b6-778b-471a-b4b3-38f110f0fd26 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.831846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 784/1563] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.831846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0411df-1c2d-4de8-8cbe-91b63d4c934f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.831846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0411df-1c2d-4de8-8cbe-91b63d4c934f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.831846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0411df-1c2d-4de8-8cbe-91b63d4c934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.832649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.832649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.832649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.832649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.833399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:45:51.833701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.834928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WARNING py.warnings [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:45:51.834928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: warnings.warn(msg) Aug 24 11:45:51.834928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: Aug 24 11:45:51.836018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.860452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 780/1564] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:45:51.860651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ec0411df-1c2d-4de8-8cbe-91b63d4c934f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:51.860767 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.860896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ec0411df-1c2d-4de8-8cbe-91b63d4c934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:51.868902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 785/1565] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:51.869721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0411df-1c2d-4de8-8cbe-91b63d4c934f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.874248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ec023-1db2-4626-b551-899b8664787b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.883879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0411df-1c2d-4de8-8cbe-91b63d4c934f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.887390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55a337-8b61-4606-91a4-32d1efc256a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.888124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55a337-8b61-4606-91a4-32d1efc256a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.888411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55a337-8b61-4606-91a4-32d1efc256a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.888691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55a337-8b61-4606-91a4-32d1efc256a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.889331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55a337-8b61-4606-91a4-32d1efc256a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.889552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa371e9-8c64-4b2b-8311-a2034d415f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:51.890173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa371e9-8c64-4b2b-8311-a2034d415f4f admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:51.890453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa371e9-8c64-4b2b-8311-a2034d415f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:51.890723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa371e9-8c64-4b2b-8311-a2034d415f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:51.891284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55a337-8b61-4606-91a4-32d1efc256a7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.891400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa371e9-8c64-4b2b-8311-a2034d415f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:45:51.891722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa371e9-8c64-4b2b-8311-a2034d415f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:51.893327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa371e9-8c64-4b2b-8311-a2034d415f4f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:51.907907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 786/1566] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:45:51.908783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa371e9-8c64-4b2b-8311-a2034d415f4f admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:51.926506 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa371e9-8c64-4b2b-8311-a2034d415f4f admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:51.928738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 781/1567] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:51 2022] POST /identity/v3/projects => generated 403 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:51.930007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55a337-8b61-4606-91a4-32d1efc256a7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.009281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61203c2d-0aa0-4003-a25e-296c1bfbfdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.009908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61203c2d-0aa0-4003-a25e-296c1bfbfdad admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.010047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55a337-8b61-4606-91a4-32d1efc256a7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.010191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61203c2d-0aa0-4003-a25e-296c1bfbfdad admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.010468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61203c2d-0aa0-4003-a25e-296c1bfbfdad admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.011693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61203c2d-0aa0-4003-a25e-296c1bfbfdad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:45:52.012094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61203c2d-0aa0-4003-a25e-296c1bfbfdad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.014135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61203c2d-0aa0-4003-a25e-296c1bfbfdad admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.016600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20aadd-0775-4b80-a20a-a207438402e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.017342 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20aadd-0775-4b80-a20a-a207438402e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.017683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20aadd-0775-4b80-a20a-a207438402e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.018007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20aadd-0775-4b80-a20a-a207438402e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.018726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20aadd-0775-4b80-a20a-a207438402e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:45:52.019122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20aadd-0775-4b80-a20a-a207438402e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.021049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20aadd-0775-4b80-a20a-a207438402e6 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.030301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 787/1568] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:45:52.031067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61203c2d-0aa0-4003-a25e-296c1bfbfdad admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.041587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 782/1569] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:45:52.042854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61203c2d-0aa0-4003-a25e-296c1bfbfdad admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.045197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20aadd-0775-4b80-a20a-a207438402e6 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.053312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5ee04-f20e-4fe1-8919-9ef7a4815cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.053935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5ee04-f20e-4fe1-8919-9ef7a4815cba admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.054212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5ee04-f20e-4fe1-8919-9ef7a4815cba admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.055177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5ee04-f20e-4fe1-8919-9ef7a4815cba admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.055332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5ee04-f20e-4fe1-8919-9ef7a4815cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:45:52.055637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5ee04-f20e-4fe1-8919-9ef7a4815cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.056542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20aadd-0775-4b80-a20a-a207438402e6 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.057409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5ee04-f20e-4fe1-8919-9ef7a4815cba admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.062323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd722a-48be-4e0b-802f-d2276b0954b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.063090 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd722a-48be-4e0b-802f-d2276b0954b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.063268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd722a-48be-4e0b-802f-d2276b0954b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.063546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd722a-48be-4e0b-802f-d2276b0954b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.065847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd722a-48be-4e0b-802f-d2276b0954b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.067932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd722a-48be-4e0b-802f-d2276b0954b2 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.082749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 788/1570] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:45:52.082749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5ee04-f20e-4fe1-8919-9ef7a4815cba admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.088637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5ee04-f20e-4fe1-8919-9ef7a4815cba admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.094578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ead559-52bf-4801-bd4e-4198040a7f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.095365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ead559-52bf-4801-bd4e-4198040a7f42 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.095653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ead559-52bf-4801-bd4e-4198040a7f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.095921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ead559-52bf-4801-bd4e-4198040a7f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.096791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ead559-52bf-4801-bd4e-4198040a7f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:45:52.097096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ead559-52bf-4801-bd4e-4198040a7f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.098809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ead559-52bf-4801-bd4e-4198040a7f42 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.103477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 783/1571] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.104301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd722a-48be-4e0b-802f-d2276b0954b2 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.119375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 789/1572] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:45:52.127057 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ead559-52bf-4801-bd4e-4198040a7f42 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.143550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ead559-52bf-4801-bd4e-4198040a7f42 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.200097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd722a-48be-4e0b-802f-d2276b0954b2 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.205709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104f0b8-4a97-4983-90ef-5eff638c277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.206335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104f0b8-4a97-4983-90ef-5eff638c277d admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.206616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104f0b8-4a97-4983-90ef-5eff638c277d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.206940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104f0b8-4a97-4983-90ef-5eff638c277d admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.207573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104f0b8-4a97-4983-90ef-5eff638c277d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.209495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104f0b8-4a97-4983-90ef-5eff638c277d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.216076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16268-e277-421f-ab3e-6a3055232eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.217041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16268-e277-421f-ab3e-6a3055232eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.217351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16268-e277-421f-ab3e-6a3055232eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.218077 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16268-e277-421f-ab3e-6a3055232eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.218846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a16268-e277-421f-ab3e-6a3055232eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.220901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a16268-e277-421f-ab3e-6a3055232eb8 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.247226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 784/1573] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.247226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104f0b8-4a97-4983-90ef-5eff638c277d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.257606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 790/1574] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/users => generated 302 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.259342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16268-e277-421f-ab3e-6a3055232eb8 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.270358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16268-e277-421f-ab3e-6a3055232eb8 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.286135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:52.307490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:52.330072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104f0b8-4a97-4983-90ef-5eff638c277d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.335563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dc28e-e83f-49b0-8f5b-a55bb2d8f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.336414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc28e-e83f-49b0-8f5b-a55bb2d8f1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.336699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc28e-e83f-49b0-8f5b-a55bb2d8f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.337101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc28e-e83f-49b0-8f5b-a55bb2d8f1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.337741 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dc28e-e83f-49b0-8f5b-a55bb2d8f1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.340306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dc28e-e83f-49b0-8f5b-a55bb2d8f1a3 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.342513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4a0c6-f97b-40ef-977b-01b1589b1c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.343168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4a0c6-f97b-40ef-977b-01b1589b1c66 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.343450 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4a0c6-f97b-40ef-977b-01b1589b1c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.343724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4a0c6-f97b-40ef-977b-01b1589b1c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.344357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4a0c6-f97b-40ef-977b-01b1589b1c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.345397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WARNING py.warnings [None req-74f4a0c6-f97b-40ef-977b-01b1589b1c66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:45:52.345397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: warnings.warn(msg) Aug 24 11:45:52.345397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: Aug 24 11:45:52.346593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4a0c6-f97b-40ef-977b-01b1589b1c66 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.377033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 785/1575] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.377033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dc28e-e83f-49b0-8f5b-a55bb2d8f1a3 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.383378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 791/1576] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.383378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4a0c6-f97b-40ef-977b-01b1589b1c66 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.456506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dc28e-e83f-49b0-8f5b-a55bb2d8f1a3 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.468986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4a0c6-f97b-40ef-977b-01b1589b1c66 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.474354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66110c49-347f-48d0-a44b-3b5d8899d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.475009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66110c49-347f-48d0-a44b-3b5d8899d94d admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.475293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66110c49-347f-48d0-a44b-3b5d8899d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.475568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66110c49-347f-48d0-a44b-3b5d8899d94d admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.476259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66110c49-347f-48d0-a44b-3b5d8899d94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.478463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66110c49-347f-48d0-a44b-3b5d8899d94d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.507906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 792/1577] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/users => generated 282 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.508924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66110c49-347f-48d0-a44b-3b5d8899d94d admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.520461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66110c49-347f-48d0-a44b-3b5d8899d94d admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.525508 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e793-ec1f-4a60-acb8-c12f815096f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.526124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e793-ec1f-4a60-acb8-c12f815096f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.526397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e793-ec1f-4a60-acb8-c12f815096f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.526750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e793-ec1f-4a60-acb8-c12f815096f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.527441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67e793-ec1f-4a60-acb8-c12f815096f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.529748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67e793-ec1f-4a60-acb8-c12f815096f2 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.530254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a13608-f5be-46f7-aa29-7e63e985c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.531002 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a13608-f5be-46f7-aa29-7e63e985c22b admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.531369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a13608-f5be-46f7-aa29-7e63e985c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.531714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a13608-f5be-46f7-aa29-7e63e985c22b admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.533135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a13608-f5be-46f7-aa29-7e63e985c22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.535420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a13608-f5be-46f7-aa29-7e63e985c22b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.566906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 793/1578] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.568049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e793-ec1f-4a60-acb8-c12f815096f2 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.584512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 786/1579] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.584512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a13608-f5be-46f7-aa29-7e63e985c22b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.637952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:52.656135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e793-ec1f-4a60-acb8-c12f815096f2 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.661198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a13608-f5be-46f7-aa29-7e63e985c22b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.662857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66d7bb-2da8-4cf4-8a0f-a97845765299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.663740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66d7bb-2da8-4cf4-8a0f-a97845765299 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.664093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66d7bb-2da8-4cf4-8a0f-a97845765299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.664464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66d7bb-2da8-4cf4-8a0f-a97845765299 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.665299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66d7bb-2da8-4cf4-8a0f-a97845765299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.667959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66d7bb-2da8-4cf4-8a0f-a97845765299 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.668315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b98f6-5dc5-43d8-b55e-9bb22a3ad9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.669055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b98f6-5dc5-43d8-b55e-9bb22a3ad9fc admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.669337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b98f6-5dc5-43d8-b55e-9bb22a3ad9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.669610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b98f6-5dc5-43d8-b55e-9bb22a3ad9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.670451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b98f6-5dc5-43d8-b55e-9bb22a3ad9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.672182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b98f6-5dc5-43d8-b55e-9bb22a3ad9fc admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.687565 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 787/1580] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:52.688456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b98f6-5dc5-43d8-b55e-9bb22a3ad9fc admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.699061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 794/1581] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.700015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66d7bb-2da8-4cf4-8a0f-a97845765299 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.706223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b98f6-5dc5-43d8-b55e-9bb22a3ad9fc admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.711793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2043d8-9550-4193-bf88-e78c67f9f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.712438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2043d8-9550-4193-bf88-e78c67f9f5ff admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.712717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2043d8-9550-4193-bf88-e78c67f9f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.712988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2043d8-9550-4193-bf88-e78c67f9f5ff admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.713619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2043d8-9550-4193-bf88-e78c67f9f5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.715338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WARNING py.warnings [None req-cd2043d8-9550-4193-bf88-e78c67f9f5ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:45:52.715338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: warnings.warn(msg) Aug 24 11:45:52.715338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: Aug 24 11:45:52.716599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2043d8-9550-4193-bf88-e78c67f9f5ff admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.717099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66d7bb-2da8-4cf4-8a0f-a97845765299 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.723503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbea7d-91d1-413b-8ce7-e3fdf7a4d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.724656 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbea7d-91d1-413b-8ce7-e3fdf7a4d760 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.725143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbea7d-91d1-413b-8ce7-e3fdf7a4d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.725677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbea7d-91d1-413b-8ce7-e3fdf7a4d760 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.726642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbea7d-91d1-413b-8ce7-e3fdf7a4d760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.729113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbea7d-91d1-413b-8ce7-e3fdf7a4d760 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.743749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:52.744986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 788/1582] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.747791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2043d8-9550-4193-bf88-e78c67f9f5ff admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.766520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 795/1583] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.766520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbea7d-91d1-413b-8ce7-e3fdf7a4d760 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.772341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2043d8-9550-4193-bf88-e78c67f9f5ff admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.777021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbea7d-91d1-413b-8ce7-e3fdf7a4d760 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.779030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb1525-7f8f-48f6-b752-5113021dd04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.780106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb1525-7f8f-48f6-b752-5113021dd04a admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.781205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb1525-7f8f-48f6-b752-5113021dd04a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.781678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb1525-7f8f-48f6-b752-5113021dd04a admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.782819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb1525-7f8f-48f6-b752-5113021dd04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.784006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985995c-1a94-457f-9b94-db997caae657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.784796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985995c-1a94-457f-9b94-db997caae657 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.785283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985995c-1a94-457f-9b94-db997caae657 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.785595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985995c-1a94-457f-9b94-db997caae657 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.786113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb1525-7f8f-48f6-b752-5113021dd04a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.786279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985995c-1a94-457f-9b94-db997caae657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.788403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985995c-1a94-457f-9b94-db997caae657 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.806830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 789/1584] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:52.809013 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb1525-7f8f-48f6-b752-5113021dd04a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.820584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 796/1585] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.820584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985995c-1a94-457f-9b94-db997caae657 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.826922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb1525-7f8f-48f6-b752-5113021dd04a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.833509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985995c-1a94-457f-9b94-db997caae657 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.838038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486f3b-2c96-4dd7-ae16-c08f82b29130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.838974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486f3b-2c96-4dd7-ae16-c08f82b29130 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.839428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486f3b-2c96-4dd7-ae16-c08f82b29130 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.839796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486f3b-2c96-4dd7-ae16-c08f82b29130 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.840366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24486f3b-2c96-4dd7-ae16-c08f82b29130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.842379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7795e-c722-4f31-9c4e-f64c1820c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.843109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24486f3b-2c96-4dd7-ae16-c08f82b29130 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.843891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7795e-c722-4f31-9c4e-f64c1820c384 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.844509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7795e-c722-4f31-9c4e-f64c1820c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.844630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7795e-c722-4f31-9c4e-f64c1820c384 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.845541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7795e-c722-4f31-9c4e-f64c1820c384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.847413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7795e-c722-4f31-9c4e-f64c1820c384 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.858955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 797/1586] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:52.863719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7795e-c722-4f31-9c4e-f64c1820c384 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.875279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 790/1587] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:52 2022] POST /identity/v3/users => generated 290 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:52.876412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7795e-c722-4f31-9c4e-f64c1820c384 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.876534 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486f3b-2c96-4dd7-ae16-c08f82b29130 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.883459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba035ed-ce1a-46dc-808d-ae73cd700fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.884123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba035ed-ce1a-46dc-808d-ae73cd700fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.884406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba035ed-ce1a-46dc-808d-ae73cd700fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.884679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba035ed-ce1a-46dc-808d-ae73cd700fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.885370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba035ed-ce1a-46dc-808d-ae73cd700fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.887358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba035ed-ce1a-46dc-808d-ae73cd700fb5 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.891839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486f3b-2c96-4dd7-ae16-c08f82b29130 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.900487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 798/1588] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:52.901543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba035ed-ce1a-46dc-808d-ae73cd700fb5 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.902996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c071f4-9857-46d9-a08f-bcea27a5c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.904107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c071f4-9857-46d9-a08f-bcea27a5c631 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.906096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c071f4-9857-46d9-a08f-bcea27a5c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.906393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c071f4-9857-46d9-a08f-bcea27a5c631 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.908852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c071f4-9857-46d9-a08f-bcea27a5c631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.910376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c071f4-9857-46d9-a08f-bcea27a5c631 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.913058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba035ed-ce1a-46dc-808d-ae73cd700fb5 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.918968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baddd32-7a78-4647-a1d2-21a7dc0e9c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.919586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baddd32-7a78-4647-a1d2-21a7dc0e9c02 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.919868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baddd32-7a78-4647-a1d2-21a7dc0e9c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.920139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baddd32-7a78-4647-a1d2-21a7dc0e9c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.920784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baddd32-7a78-4647-a1d2-21a7dc0e9c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.922463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baddd32-7a78-4647-a1d2-21a7dc0e9c02 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.928330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 791/1589] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:52.928330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c071f4-9857-46d9-a08f-bcea27a5c631 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.938829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 799/1590] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:52.939040 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c071f4-9857-46d9-a08f-bcea27a5c631 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.939129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baddd32-7a78-4647-a1d2-21a7dc0e9c02 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.948508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dc3af-553a-4d0b-ac1b-b8a5974eeef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.949478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc3af-553a-4d0b-ac1b-b8a5974eeef2 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.950153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc3af-553a-4d0b-ac1b-b8a5974eeef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.950630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc3af-553a-4d0b-ac1b-b8a5974eeef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.951527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dc3af-553a-4d0b-ac1b-b8a5974eeef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.953366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dc3af-553a-4d0b-ac1b-b8a5974eeef2 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.957042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baddd32-7a78-4647-a1d2-21a7dc0e9c02 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.962666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3db2-ce0c-42a7-bc92-ab8ba5feae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.963457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3db2-ce0c-42a7-bc92-ab8ba5feae91 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.963848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3db2-ce0c-42a7-bc92-ab8ba5feae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.964734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb3db2-ce0c-42a7-bc92-ab8ba5feae91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.965554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb3db2-ce0c-42a7-bc92-ab8ba5feae91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:52.967422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb3db2-ce0c-42a7-bc92-ab8ba5feae91 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:52.970191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 792/1591] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:52.971285 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dc3af-553a-4d0b-ac1b-b8a5974eeef2 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.983142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dc3af-553a-4d0b-ac1b-b8a5974eeef2 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:52.984016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 800/1592] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:52.987211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3db2-ce0c-42a7-bc92-ab8ba5feae91 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:52.989050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c95111-6bb8-4f9e-9bd8-4d64235a5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:52.989728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c95111-6bb8-4f9e-9bd8-4d64235a5426 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:52.990007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c95111-6bb8-4f9e-9bd8-4d64235a5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:52.990282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c95111-6bb8-4f9e-9bd8-4d64235a5426 admin admin] PATH_INFO: `/v3/projects/61c6260fd0764fdc9cfc7f3c079a9d5e/users/10ff926f66584d139a90cd544a02795a/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:52.997568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb3db2-ce0c-42a7-bc92-ab8ba5feae91 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.003006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91b4d8-ab3b-4fc6-be08-fec5340d5d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.003858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b4d8-ab3b-4fc6-be08-fec5340d5d9b admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.004295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b4d8-ab3b-4fc6-be08-fec5340d5d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.004633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b4d8-ab3b-4fc6-be08-fec5340d5d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.005485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91b4d8-ab3b-4fc6-be08-fec5340d5d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.007312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91b4d8-ab3b-4fc6-be08-fec5340d5d9b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.007670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c95111-6bb8-4f9e-9bd8-4d64235a5426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c6260fd0764fdc9cfc7f3c079a9d5e, user_id=10ff926f66584d139a90cd544a02795a, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.010649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c95111-6bb8-4f9e-9bd8-4d64235a5426 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.023230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 801/1593] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:53.024349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91b4d8-ab3b-4fc6-be08-fec5340d5d9b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.034251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 793/1594] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:52 2022] PUT /identity/v3/projects/61c6260fd0764fdc9cfc7f3c079a9d5e/users/10ff926f66584d139a90cd544a02795a/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:53.035929 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c95111-6bb8-4f9e-9bd8-4d64235a5426 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.039345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91b4d8-ab3b-4fc6-be08-fec5340d5d9b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.104346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7947127-08e7-40c7-a1fd-f62a70f8e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.105110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7947127-08e7-40c7-a1fd-f62a70f8e444 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.105461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7947127-08e7-40c7-a1fd-f62a70f8e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.105799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7947127-08e7-40c7-a1fd-f62a70f8e444 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.106569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7947127-08e7-40c7-a1fd-f62a70f8e444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.109116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7947127-08e7-40c7-a1fd-f62a70f8e444 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.123839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 802/1595] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:53.125039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7947127-08e7-40c7-a1fd-f62a70f8e444 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.127460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c95111-6bb8-4f9e-9bd8-4d64235a5426 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.135110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512576a-8584-43e7-b592-488214a9a5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.135547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512576a-8584-43e7-b592-488214a9a5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.135829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512576a-8584-43e7-b592-488214a9a5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.137006 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512576a-8584-43e7-b592-488214a9a5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.137497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7947127-08e7-40c7-a1fd-f62a70f8e444 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.137808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512576a-8584-43e7-b592-488214a9a5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.139571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512576a-8584-43e7-b592-488214a9a5b9 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.143749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832487d-19ee-4dec-921f-8a4d2719e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.144733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832487d-19ee-4dec-921f-8a4d2719e1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.145206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832487d-19ee-4dec-921f-8a4d2719e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.145554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832487d-19ee-4dec-921f-8a4d2719e1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.146496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832487d-19ee-4dec-921f-8a4d2719e1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.149328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832487d-19ee-4dec-921f-8a4d2719e1a6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.166380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 794/1596] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:53.168394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512576a-8584-43e7-b592-488214a9a5b9 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.175461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 803/1597] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:53.176336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832487d-19ee-4dec-921f-8a4d2719e1a6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.193433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832487d-19ee-4dec-921f-8a4d2719e1a6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.199103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512576a-8584-43e7-b592-488214a9a5b9 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.204442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4763507-a225-4eb1-ac70-6fba453ea6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.205188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4763507-a225-4eb1-ac70-6fba453ea6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.205384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4763507-a225-4eb1-ac70-6fba453ea6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.205657 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4763507-a225-4eb1-ac70-6fba453ea6b3 admin admin] PATH_INFO: `/v3/projects/63ed4496631743f6af78f5e5bcf07d0b/users/bf2f48d6e6a84717b5d5c09c9b18df00/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.206474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b029db-0b1a-42d6-bb8a-36273f51af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.207130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b029db-0b1a-42d6-bb8a-36273f51af46 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.207410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b029db-0b1a-42d6-bb8a-36273f51af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.207684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b029db-0b1a-42d6-bb8a-36273f51af46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.208334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b029db-0b1a-42d6-bb8a-36273f51af46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.209994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b029db-0b1a-42d6-bb8a-36273f51af46 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.224439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 804/1598] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:53.224439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b029db-0b1a-42d6-bb8a-36273f51af46 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.235188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b029db-0b1a-42d6-bb8a-36273f51af46 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.237780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4763507-a225-4eb1-ac70-6fba453ea6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ed4496631743f6af78f5e5bcf07d0b, user_id=bf2f48d6e6a84717b5d5c09c9b18df00, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.240246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dbaab-87a7-4d09-85b0-bafff64f9bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.240863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dbaab-87a7-4d09-85b0-bafff64f9bac admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.241143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dbaab-87a7-4d09-85b0-bafff64f9bac admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.241469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dbaab-87a7-4d09-85b0-bafff64f9bac admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.242163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dbaab-87a7-4d09-85b0-bafff64f9bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.242560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4763507-a225-4eb1-ac70-6fba453ea6b3 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.244210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dbaab-87a7-4d09-85b0-bafff64f9bac admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.261930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 805/1599] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:53.264268 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71dc40-d17f-4e6f-b27c-9936c7339310 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.264705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71dc40-d17f-4e6f-b27c-9936c7339310 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.265093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71dc40-d17f-4e6f-b27c-9936c7339310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.271592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 795/1600] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:53 2022] PUT /identity/v3/projects/63ed4496631743f6af78f5e5bcf07d0b/users/bf2f48d6e6a84717b5d5c09c9b18df00/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:53.272735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4763507-a225-4eb1-ac70-6fba453ea6b3 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.302484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ec71dc40-d17f-4e6f-b27c-9936c7339310 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:53.307386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ec71dc40-d17f-4e6f-b27c-9936c7339310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:53.312773 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:53.359174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:53.379657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 806/1601] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:53.381115 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71dc40-d17f-4e6f-b27c-9936c7339310 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.388314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4763507-a225-4eb1-ac70-6fba453ea6b3 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.395330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf19da0-982c-4986-966a-0520eb55f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.395816 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71dc40-d17f-4e6f-b27c-9936c7339310 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.396325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf19da0-982c-4986-966a-0520eb55f979 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.396689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf19da0-982c-4986-966a-0520eb55f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.397030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf19da0-982c-4986-966a-0520eb55f979 admin admin] PATH_INFO: `/v3/projects/692af88d80d94882ab926cf88e58d24b/users/a066d4114d3b438cacd7437966d17c66/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.403507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0674-7e45-4cc3-b360-929a46a0112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.403846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0674-7e45-4cc3-b360-929a46a0112e admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.404194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0674-7e45-4cc3-b360-929a46a0112e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.404536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0674-7e45-4cc3-b360-929a46a0112e admin admin] PATH_INFO: `/v3/projects/82cb793b820748d3a224512931cbb154/users/5b91971b2a994d348a4e695b261ad914/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.421658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf19da0-982c-4986-966a-0520eb55f979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=692af88d80d94882ab926cf88e58d24b, user_id=a066d4114d3b438cacd7437966d17c66, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.421906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0674-7e45-4cc3-b360-929a46a0112e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cb793b820748d3a224512931cbb154, user_id=5b91971b2a994d348a4e695b261ad914, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.422966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WARNING py.warnings [None req-7a7b0674-7e45-4cc3-b360-929a46a0112e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:45:53.422966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: warnings.warn(msg) Aug 24 11:45:53.422966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: Aug 24 11:45:53.424808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf19da0-982c-4986-966a-0520eb55f979 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.425335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0674-7e45-4cc3-b360-929a46a0112e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.444302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 807/1602] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:53 2022] PUT /identity/v3/projects/82cb793b820748d3a224512931cbb154/users/5b91971b2a994d348a4e695b261ad914/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:53.444957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 796/1603] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:53 2022] PUT /identity/v3/projects/692af88d80d94882ab926cf88e58d24b/users/a066d4114d3b438cacd7437966d17c66/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:53.445821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf19da0-982c-4986-966a-0520eb55f979 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.454283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0674-7e45-4cc3-b360-929a46a0112e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.568309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0674-7e45-4cc3-b360-929a46a0112e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.578352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912b830-ebd8-4f82-ad3b-b01a007bfb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.578602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf19da0-982c-4986-966a-0520eb55f979 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.579174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912b830-ebd8-4f82-ad3b-b01a007bfb74 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.579522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912b830-ebd8-4f82-ad3b-b01a007bfb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.579861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912b830-ebd8-4f82-ad3b-b01a007bfb74 admin admin] PATH_INFO: `/v3/projects/56f5e626cfad49a68a71444d5c38e8f6/users/d9c69e18847a40379daf843e87dad68b/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.584832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f21297-8285-4c44-b49a-a7233b3983b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.585866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21297-8285-4c44-b49a-a7233b3983b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.586150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21297-8285-4c44-b49a-a7233b3983b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.586421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21297-8285-4c44-b49a-a7233b3983b4 admin admin] PATH_INFO: `/v3/projects/f61b8d48123c4dfdb4f3fa1977d38887/users/f8789f7c1cc847beafa70b9cebc06c73/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.601249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912b830-ebd8-4f82-ad3b-b01a007bfb74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f5e626cfad49a68a71444d5c38e8f6, user_id=d9c69e18847a40379daf843e87dad68b, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.605479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912b830-ebd8-4f82-ad3b-b01a007bfb74 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.608373 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f21297-8285-4c44-b49a-a7233b3983b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61b8d48123c4dfdb4f3fa1977d38887, user_id=f8789f7c1cc847beafa70b9cebc06c73, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.612302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f21297-8285-4c44-b49a-a7233b3983b4 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.630247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 797/1604] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:53 2022] PUT /identity/v3/projects/f61b8d48123c4dfdb4f3fa1977d38887/users/f8789f7c1cc847beafa70b9cebc06c73/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:53.642410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f21297-8285-4c44-b49a-a7233b3983b4 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.648668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 808/1605] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:53 2022] PUT /identity/v3/projects/56f5e626cfad49a68a71444d5c38e8f6/users/d9c69e18847a40379daf843e87dad68b/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:53.655808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a66b3-53ad-4398-8038-c8cb6a7efe4e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.656470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a66b3-53ad-4398-8038-c8cb6a7efe4e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.656755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a66b3-53ad-4398-8038-c8cb6a7efe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.694409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a40a66b3-53ad-4398-8038-c8cb6a7efe4e None None] MFA Rules not processed for user `bf2f48d6e6a84717b5d5c09c9b18df00`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:53.695815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a40a66b3-53ad-4398-8038-c8cb6a7efe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:53.730715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f21297-8285-4c44-b49a-a7233b3983b4 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:53.771785 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:53.893250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afc4c3-7216-4d43-bd37-d94db9d83e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:53.893250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afc4c3-7216-4d43-bd37-d94db9d83e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.893250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afc4c3-7216-4d43-bd37-d94db9d83e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.893250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afc4c3-7216-4d43-bd37-d94db9d83e31 admin admin] PATH_INFO: `/v3/projects/f844197232cc4b5597f38a410150f154/users/8e96e106cdd14b898253b1c90fb582da/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.901166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 809/1606] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:53.901166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a66b3-53ad-4398-8038-c8cb6a7efe4e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:53.902344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afc4c3-7216-4d43-bd37-d94db9d83e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f844197232cc4b5597f38a410150f154, user_id=8e96e106cdd14b898253b1c90fb582da, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:53.902344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afc4c3-7216-4d43-bd37-d94db9d83e31 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:53.902344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 798/1607] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:53 2022] PUT /identity/v3/projects/f844197232cc4b5597f38a410150f154/users/8e96e106cdd14b898253b1c90fb582da/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:53.902344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775575b6-2e16-4332-85b1-4a7a3142e1c4 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:53.902344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775575b6-2e16-4332-85b1-4a7a3142e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:53.902344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775575b6-2e16-4332-85b1-4a7a3142e1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:53.907030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:53.933712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-775575b6-2e16-4332-85b1-4a7a3142e1c4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:53.935459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-775575b6-2e16-4332-85b1-4a7a3142e1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:53.946951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a66b3-53ad-4398-8038-c8cb6a7efe4e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.020369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0a7b0-4ea4-4148-870d-4d41e73c3dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.021485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0a7b0-4ea4-4148-870d-4d41e73c3dee service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.022085 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0a7b0-4ea4-4148-870d-4d41e73c3dee service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.022673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0a7b0-4ea4-4148-870d-4d41e73c3dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.028597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 799/1608] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:54.032673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb12d95-98d1-439f-9cde-7664f61ccca2 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.032960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb12d95-98d1-439f-9cde-7664f61ccca2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.033234 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb12d95-98d1-439f-9cde-7664f61ccca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.036341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0a7b0-4ea4-4148-870d-4d41e73c3dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.037927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0a7b0-4ea4-4148-870d-4d41e73c3dee service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.052798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 810/1609] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:45:54.053311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-abb12d95-98d1-439f-9cde-7664f61ccca2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:54.053970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e7fa-ae89-4bdf-b35a-f1ece44931dc None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.054441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e7fa-ae89-4bdf-b35a-f1ece44931dc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.054571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-abb12d95-98d1-439f-9cde-7664f61ccca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:54.054664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e7fa-ae89-4bdf-b35a-f1ece44931dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.066488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 800/1610] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:54.066488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bf4de-e236-405c-93c8-36c48344398a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.066488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bf4de-e236-405c-93c8-36c48344398a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.066488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bf4de-e236-405c-93c8-36c48344398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.087041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-fc2bf4de-e236-405c-93c8-36c48344398a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:54.088539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fc2bf4de-e236-405c-93c8-36c48344398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:54.098965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-06e5e7fa-ae89-4bdf-b35a-f1ece44931dc None None] MFA Rules not processed for user `f8789f7c1cc847beafa70b9cebc06c73`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:54.100189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-06e5e7fa-ae89-4bdf-b35a-f1ece44931dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:54.108698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 801/1611] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:54.109755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bf4de-e236-405c-93c8-36c48344398a None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.122835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bf4de-e236-405c-93c8-36c48344398a None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.131345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840e252-f6f3-444e-823a-d2caffb88b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.132678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840e252-f6f3-444e-823a-d2caffb88b4e admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.133083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840e252-f6f3-444e-823a-d2caffb88b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.133494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840e252-f6f3-444e-823a-d2caffb88b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.134660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840e252-f6f3-444e-823a-d2caffb88b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.138019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840e252-f6f3-444e-823a-d2caffb88b4e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.189975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 811/1612] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:54.191870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa35d8-1b46-4f4e-846b-8ab0181b1555 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.192469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa35d8-1b46-4f4e-846b-8ab0181b1555 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.192997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa35d8-1b46-4f4e-846b-8ab0181b1555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.200959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 802/1613] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:54 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:54.201810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840e252-f6f3-444e-823a-d2caffb88b4e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.260551 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b8fa35d8-1b46-4f4e-846b-8ab0181b1555 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:54.266611 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b8fa35d8-1b46-4f4e-846b-8ab0181b1555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:54.274430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840e252-f6f3-444e-823a-d2caffb88b4e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.300358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541a29-4498-4e1f-88a9-b6317bdaa630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.301144 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541a29-4498-4e1f-88a9-b6317bdaa630 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.301672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541a29-4498-4e1f-88a9-b6317bdaa630 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.302033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541a29-4498-4e1f-88a9-b6317bdaa630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.381152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 812/1614] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:54.381152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa35d8-1b46-4f4e-846b-8ab0181b1555 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.393396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa35d8-1b46-4f4e-846b-8ab0181b1555 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.395026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:54.400261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20606ba-c8fd-43af-86b7-d9118b0c98fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.401381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20606ba-c8fd-43af-86b7-d9118b0c98fa service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.401525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20606ba-c8fd-43af-86b7-d9118b0c98fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.402638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20606ba-c8fd-43af-86b7-d9118b0c98fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.420933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20606ba-c8fd-43af-86b7-d9118b0c98fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.422541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20606ba-c8fd-43af-86b7-d9118b0c98fa service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.439248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 813/1615] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:45:54.440388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20606ba-c8fd-43af-86b7-d9118b0c98fa service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.448511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541a29-4498-4e1f-88a9-b6317bdaa630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.450052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541a29-4498-4e1f-88a9-b6317bdaa630 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.450865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20606ba-c8fd-43af-86b7-d9118b0c98fa service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.454962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665b72c-e0ef-453f-a33e-567ea78e5caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.455666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b72c-e0ef-453f-a33e-567ea78e5caa service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.456097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b72c-e0ef-453f-a33e-567ea78e5caa service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.456375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b72c-e0ef-453f-a33e-567ea78e5caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.461440 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 803/1616] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:45:54.462801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541a29-4498-4e1f-88a9-b6317bdaa630 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.471039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665b72c-e0ef-453f-a33e-567ea78e5caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.472853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665b72c-e0ef-453f-a33e-567ea78e5caa service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.476589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541a29-4498-4e1f-88a9-b6317bdaa630 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.479147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:54.501058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a112b10-ae7e-4558-aa70-cc0eb8e8fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.501572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a112b10-ae7e-4558-aa70-cc0eb8e8fa5a admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.501854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a112b10-ae7e-4558-aa70-cc0eb8e8fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.502125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a112b10-ae7e-4558-aa70-cc0eb8e8fa5a admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.503197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a112b10-ae7e-4558-aa70-cc0eb8e8fa5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.504718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 814/1617] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:45:54.505237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a112b10-ae7e-4558-aa70-cc0eb8e8fa5a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.506212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f295-0979-4886-9676-8b348bc999a4 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.506500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f295-0979-4886-9676-8b348bc999a4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.506847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f295-0979-4886-9676-8b348bc999a4 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.514594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 815/1618] 10.222.0.59 () {54 vars in 962 bytes} [Wed Aug 24 11:45:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:45:54.516212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a98053-207b-4cef-b328-9816007055d7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.516563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a98053-207b-4cef-b328-9816007055d7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.516836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a98053-207b-4cef-b328-9816007055d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.545420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 804/1619] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:54 2022] POST /identity/v3/users => generated 289 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:54.547346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a112b10-ae7e-4558-aa70-cc0eb8e8fa5a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.572399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a112b10-ae7e-4558-aa70-cc0eb8e8fa5a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.583051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf01d0-713c-4fa5-8da6-ad21e898078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.584846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf01d0-713c-4fa5-8da6-ad21e898078e admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.585126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf01d0-713c-4fa5-8da6-ad21e898078e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.585393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf01d0-713c-4fa5-8da6-ad21e898078e admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.587756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf01d0-713c-4fa5-8da6-ad21e898078e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.590838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf01d0-713c-4fa5-8da6-ad21e898078e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.615222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-83a98053-207b-4cef-b328-9816007055d7 None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:54.619750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-83a98053-207b-4cef-b328-9816007055d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:54.623193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 805/1620] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:54.624987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf01d0-713c-4fa5-8da6-ad21e898078e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.647228 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf01d0-713c-4fa5-8da6-ad21e898078e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.663458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3619a5-7cb3-4f83-af8b-c07139d26fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.664209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3619a5-7cb3-4f83-af8b-c07139d26fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.664897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3619a5-7cb3-4f83-af8b-c07139d26fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.664897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3619a5-7cb3-4f83-af8b-c07139d26fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.678349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3619a5-7cb3-4f83-af8b-c07139d26fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.680179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3619a5-7cb3-4f83-af8b-c07139d26fc8 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.697548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 806/1621] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:45:54.698993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3619a5-7cb3-4f83-af8b-c07139d26fc8 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.710483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 816/1622] 10.222.0.59 () {58 vars in 1059 bytes} [Wed Aug 24 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:54.713065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3619a5-7cb3-4f83-af8b-c07139d26fc8 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.723018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a98053-207b-4cef-b328-9816007055d7 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.725536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4444a-3721-4c07-874f-e750016caa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.726219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4444a-3721-4c07-874f-e750016caa5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.726500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4444a-3721-4c07-874f-e750016caa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.726794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4444a-3721-4c07-874f-e750016caa5b admin admin] PATH_INFO: `/v3/projects/37f9ab8877c141d8abf5705666b1644c/users/42c47027b81b4b67afc24abe7e3bba30/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.742499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a98053-207b-4cef-b328-9816007055d7 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.758408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4444a-3721-4c07-874f-e750016caa5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f9ab8877c141d8abf5705666b1644c, user_id=42c47027b81b4b67afc24abe7e3bba30, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.759588 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7d464-45b4-4891-a3e4-5c3de9313a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.760634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7d464-45b4-4891-a3e4-5c3de9313a59 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.761882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4444a-3721-4c07-874f-e750016caa5b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.762455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7d464-45b4-4891-a3e4-5c3de9313a59 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.762917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7d464-45b4-4891-a3e4-5c3de9313a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.788960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 807/1623] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:54 2022] PUT /identity/v3/projects/37f9ab8877c141d8abf5705666b1644c/users/42c47027b81b4b67afc24abe7e3bba30/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:54.796679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4444a-3721-4c07-874f-e750016caa5b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:54.879448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7d464-45b4-4891-a3e4-5c3de9313a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.881332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7d464-45b4-4891-a3e4-5c3de9313a59 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:54.911571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 817/1624] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:45:54.922215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4444a-3721-4c07-874f-e750016caa5b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:54.946400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5c0a5-1db1-42b7-9fe0-f884986331fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:54.946743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5c0a5-1db1-42b7-9fe0-f884986331fc admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:54.947063 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5c0a5-1db1-42b7-9fe0-f884986331fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:54.947360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5c0a5-1db1-42b7-9fe0-f884986331fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:54.947996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5c0a5-1db1-42b7-9fe0-f884986331fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:54.950951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5c0a5-1db1-42b7-9fe0-f884986331fc admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:55.006936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 808/1625] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:55.008119 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7d464-45b4-4891-a3e4-5c3de9313a59 service nova] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:55.033949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7d464-45b4-4891-a3e4-5c3de9313a59 service nova] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:55.046922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4470c-d4ab-49e7-9c19-351f968b929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:55.047954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4470c-d4ab-49e7-9c19-351f968b929e admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:55.048237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4470c-d4ab-49e7-9c19-351f968b929e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:55.048512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4470c-d4ab-49e7-9c19-351f968b929e admin admin] PATH_INFO: `/v3/projects/37f9ab8877c141d8abf5705666b1644c/users/42c47027b81b4b67afc24abe7e3bba30/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:55.055562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4470c-d4ab-49e7-9c19-351f968b929e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f9ab8877c141d8abf5705666b1644c, user_id=42c47027b81b4b67afc24abe7e3bba30, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:55.062189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4470c-d4ab-49e7-9c19-351f968b929e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:55.093475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 818/1626] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:55 2022] PUT /identity/v3/projects/37f9ab8877c141d8abf5705666b1644c/users/42c47027b81b4b67afc24abe7e3bba30/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:55.103820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993d7a-a8e9-45fa-9f7d-a2e1d23ddf0a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:55.103820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993d7a-a8e9-45fa-9f7d-a2e1d23ddf0a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:55.104114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b993d7a-a8e9-45fa-9f7d-a2e1d23ddf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:55.168709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3b993d7a-a8e9-45fa-9f7d-a2e1d23ddf0a None None] MFA Rules not processed for user `42c47027b81b4b67afc24abe7e3bba30`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:55.170210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3b993d7a-a8e9-45fa-9f7d-a2e1d23ddf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:55.284774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:55.352146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 809/1627] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:55.371162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4470c-d4ab-49e7-9c19-351f968b929e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:55.441367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f3ac5-add9-43c8-94b0-695e803fb712 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:55.441589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f3ac5-add9-43c8-94b0-695e803fb712 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:55.441884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f3ac5-add9-43c8-94b0-695e803fb712 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:55.443312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 810/1628] 10.222.0.59 () {54 vars in 912 bytes} [Wed Aug 24 11:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 11:45:55.459358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd3b8c-54dd-40c5-bb55-bb00c78b2605 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:55.459728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd3b8c-54dd-40c5-bb55-bb00c78b2605 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:55.460027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd3b8c-54dd-40c5-bb55-bb00c78b2605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:55.550553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4470c-d4ab-49e7-9c19-351f968b929e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:55.552233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c0cd3b8c-54dd-40c5-bb55-bb00c78b2605 None None] MFA Rules not processed for user `10ff926f66584d139a90cd544a02795a`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:55.556397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c0cd3b8c-54dd-40c5-bb55-bb00c78b2605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:55.557150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0f2bb-1be6-4250-80ac-582dcfbfc842 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:55.559228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0f2bb-1be6-4250-80ac-582dcfbfc842 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:55.559547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0f2bb-1be6-4250-80ac-582dcfbfc842 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:55.559890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0f2bb-1be6-4250-80ac-582dcfbfc842 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:55.577545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0f2bb-1be6-4250-80ac-582dcfbfc842 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:55.579919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0f2bb-1be6-4250-80ac-582dcfbfc842 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:55.601031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 819/1629] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:45:55.603003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950af5-053d-4a57-ab7c-3175e141045d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:55.603297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950af5-053d-4a57-ab7c-3175e141045d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:55.603622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950af5-053d-4a57-ab7c-3175e141045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:55.614019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:55.659355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-bf950af5-053d-4a57-ab7c-3175e141045d None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:55.663098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-bf950af5-053d-4a57-ab7c-3175e141045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:55.778065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 811/1630] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:45:55.781762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd3b8c-54dd-40c5-bb55-bb00c78b2605 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:55.832136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 820/1631] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:45:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:55.842907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf950af5-053d-4a57-ab7c-3175e141045d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:55.860671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf950af5-053d-4a57-ab7c-3175e141045d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:55.867695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcd4a0-1436-4ec6-b316-e02906848a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:55.873311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcd4a0-1436-4ec6-b316-e02906848a6d service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:55.873311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcd4a0-1436-4ec6-b316-e02906848a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:55.873311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcd4a0-1436-4ec6-b316-e02906848a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:55.903504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcd4a0-1436-4ec6-b316-e02906848a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:55.906181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcd4a0-1436-4ec6-b316-e02906848a6d service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:55.945926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 821/1632] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:45:55.946507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd3b8c-54dd-40c5-bb55-bb00c78b2605 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:55.951807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea70a7-a5c1-447b-90ac-8b0f3c56195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:55.952522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea70a7-a5c1-447b-90ac-8b0f3c56195a admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:55.953100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea70a7-a5c1-447b-90ac-8b0f3c56195a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:55.953384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea70a7-a5c1-447b-90ac-8b0f3c56195a admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:55.954421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea70a7-a5c1-447b-90ac-8b0f3c56195a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:55.956165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea70a7-a5c1-447b-90ac-8b0f3c56195a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:56.029892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 812/1633] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:45:55 2022] POST /identity/v3/projects => generated 405 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:56.034860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcd4a0-1436-4ec6-b316-e02906848a6d service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:56.052274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcd4a0-1436-4ec6-b316-e02906848a6d service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:56.200168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cbf79-72fe-4058-a2fc-2339a7e4b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:56.201041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cbf79-72fe-4058-a2fc-2339a7e4b299 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:56.201331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cbf79-72fe-4058-a2fc-2339a7e4b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:56.203809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cbf79-72fe-4058-a2fc-2339a7e4b299 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:56.204701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cbf79-72fe-4058-a2fc-2339a7e4b299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:56.210360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cbf79-72fe-4058-a2fc-2339a7e4b299 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:56.274098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 822/1634] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:45:56 2022] POST /identity/v3/users => generated 309 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:45:56.276684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea70a7-a5c1-447b-90ac-8b0f3c56195a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:56.297803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea70a7-a5c1-447b-90ac-8b0f3c56195a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:56.314477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe1efe-fba6-4b79-a44a-71fe2584ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:56.316687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe1efe-fba6-4b79-a44a-71fe2584ca32 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:56.316851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe1efe-fba6-4b79-a44a-71fe2584ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:56.317139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe1efe-fba6-4b79-a44a-71fe2584ca32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:56.319076 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe1efe-fba6-4b79-a44a-71fe2584ca32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:56.324464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe1efe-fba6-4b79-a44a-71fe2584ca32 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:56.359005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 813/1635] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:56.365128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cbf79-72fe-4058-a2fc-2339a7e4b299 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:56.386566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cbf79-72fe-4058-a2fc-2339a7e4b299 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:56.408014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868ff22-31ca-4d1c-aa69-8bc0010cb62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:56.409333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868ff22-31ca-4d1c-aa69-8bc0010cb62b admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:56.412386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868ff22-31ca-4d1c-aa69-8bc0010cb62b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:56.413402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868ff22-31ca-4d1c-aa69-8bc0010cb62b admin admin] PATH_INFO: `/v3/projects/e1167856f37c428c922ee5429c5471f8/users/8194ea8a4cfa41288a6a603d155ab18e/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:56.470028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868ff22-31ca-4d1c-aa69-8bc0010cb62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1167856f37c428c922ee5429c5471f8, user_id=8194ea8a4cfa41288a6a603d155ab18e, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:56.484917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868ff22-31ca-4d1c-aa69-8bc0010cb62b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:56.533834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 823/1636] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:56 2022] PUT /identity/v3/projects/e1167856f37c428c922ee5429c5471f8/users/8194ea8a4cfa41288a6a603d155ab18e/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:56.539059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe1efe-fba6-4b79-a44a-71fe2584ca32 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:56.554409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe1efe-fba6-4b79-a44a-71fe2584ca32 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:56.612115 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868ff22-31ca-4d1c-aa69-8bc0010cb62b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:56.679658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:56.697318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cda07-59ec-4f85-b352-e432a16cbe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:56.698360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cda07-59ec-4f85-b352-e432a16cbe6d admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:56.698360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cda07-59ec-4f85-b352-e432a16cbe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:56.699221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cda07-59ec-4f85-b352-e432a16cbe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:56.700626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cda07-59ec-4f85-b352-e432a16cbe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:56.702401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cda07-59ec-4f85-b352-e432a16cbe6d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:56.720908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 814/1637] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:45:56.722102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cda07-59ec-4f85-b352-e432a16cbe6d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:56.734984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cda07-59ec-4f85-b352-e432a16cbe6d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:56.742226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0f663-6ef6-40fc-aeb7-41cfcaa1a2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:56.744204 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0f663-6ef6-40fc-aeb7-41cfcaa1a2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:56.744648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0f663-6ef6-40fc-aeb7-41cfcaa1a2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:56.745111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0f663-6ef6-40fc-aeb7-41cfcaa1a2ff admin admin] PATH_INFO: `/v3/projects/e1167856f37c428c922ee5429c5471f8/users/8194ea8a4cfa41288a6a603d155ab18e/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:56.749735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0f663-6ef6-40fc-aeb7-41cfcaa1a2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1167856f37c428c922ee5429c5471f8, user_id=8194ea8a4cfa41288a6a603d155ab18e, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:56.751662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:56.753536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0f663-6ef6-40fc-aeb7-41cfcaa1a2ff admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:56.775867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 815/1638] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:45:56 2022] PUT /identity/v3/projects/e1167856f37c428c922ee5429c5471f8/users/8194ea8a4cfa41288a6a603d155ab18e/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:56.791545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868ff22-31ca-4d1c-aa69-8bc0010cb62b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:56.936803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:56.937520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:56.937808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:56.939775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] PATH_INFO: `/v3/users/bf2f48d6e6a84717b5d5c09c9b18df00` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:56.942194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2f48d6e6a84717b5d5c09c9b18df00)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:56.943271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: WARNING py.warnings [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:45:56.943271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: warnings.warn(msg) Aug 24 11:45:56.943271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: Aug 24 11:45:56.944498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:57.112604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2f48d6e6a84717b5d5c09c9b18df00'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:45:57.113704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2f48d6e6a84717b5d5c09c9b18df00'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:45:57.114012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2f48d6e6a84717b5d5c09c9b18df00'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:45:57.138779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2f48d6e6a84717b5d5c09c9b18df00'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:45:57.160444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2f48d6e6a84717b5d5c09c9b18df00'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:45:57.217078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 824/1639] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:45:56 2022] DELETE /identity/v3/users/bf2f48d6e6a84717b5d5c09c9b18df00 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:45:57.218399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426545d-6a5b-4a89-9014-1ba48ccfcf6f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:57.219041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426545d-6a5b-4a89-9014-1ba48ccfcf6f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:57.219401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426545d-6a5b-4a89-9014-1ba48ccfcf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:57.282576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b426545d-6a5b-4a89-9014-1ba48ccfcf6f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:57.289821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b426545d-6a5b-4a89-9014-1ba48ccfcf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:57.519915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 816/1640] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:57.687049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:57.689011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:57.827666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd1cf-a983-40e2-9f66-3142653ac38a admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:57.837113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27952cf5-dcd8-4717-95de-4896d7ac0b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:57.837930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27952cf5-dcd8-4717-95de-4896d7ac0b22 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:57.840720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27952cf5-dcd8-4717-95de-4896d7ac0b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:57.840720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27952cf5-dcd8-4717-95de-4896d7ac0b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:57.863583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27952cf5-dcd8-4717-95de-4896d7ac0b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:57.865266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27952cf5-dcd8-4717-95de-4896d7ac0b22 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:57.883503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e802-123f-4aea-8e13-d0785e6e3f92 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:57.883952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e802-123f-4aea-8e13-d0785e6e3f92 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:57.884350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e802-123f-4aea-8e13-d0785e6e3f92 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:57.888083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 817/1641] 10.222.0.59 () {54 vars in 962 bytes} [Wed Aug 24 11:45:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:45:57.894756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 825/1642] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:45:57.905077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa748-a87d-4160-9005-6658f3598ad0 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:57.905455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa748-a87d-4160-9005-6658f3598ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:57.905733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa748-a87d-4160-9005-6658f3598ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:57.955485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ad9aa748-a87d-4160-9005-6658f3598ad0 None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:57.956898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ad9aa748-a87d-4160-9005-6658f3598ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:58.113665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 818/1643] 10.222.0.59 () {58 vars in 1059 bytes} [Wed Aug 24 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:58.119940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8971-bd2e-4614-b5b3-6a3eb25ef007 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:58.121100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8971-bd2e-4614-b5b3-6a3eb25ef007 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:58.121100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8971-bd2e-4614-b5b3-6a3eb25ef007 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:58.122637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 826/1644] 10.222.0.59 () {54 vars in 912 bytes} [Wed Aug 24 11:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:45:58.128347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded06f0e-6154-4a7c-9f35-90c3bfbc8a9c None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:58.128661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded06f0e-6154-4a7c-9f35-90c3bfbc8a9c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:58.128909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded06f0e-6154-4a7c-9f35-90c3bfbc8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:58.164490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ded06f0e-6154-4a7c-9f35-90c3bfbc8a9c None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:45:58.167046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ded06f0e-6154-4a7c-9f35-90c3bfbc8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:58.186359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 819/1645] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:45:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:45:58.215837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee8971-bd2e-4614-b5b3-6a3eb25ef007 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:45:58.218030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4dee8971-bd2e-4614-b5b3-6a3eb25ef007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:45:58.272929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:45:58.389792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee8971-bd2e-4614-b5b3-6a3eb25ef007 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:45:58.405443 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d81d0-358a-41c4-9d30-6977949732ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:45:58.406003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d81d0-358a-41c4-9d30-6977949732ca service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:45:58.406301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d81d0-358a-41c4-9d30-6977949732ca service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:45:58.406554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d81d0-358a-41c4-9d30-6977949732ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:45:58.418149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d81d0-358a-41c4-9d30-6977949732ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:45:58.421010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d81d0-358a-41c4-9d30-6977949732ca service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:45:58.445300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 827/1646] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:45:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:00.154266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d69497-20ba-4d89-a812-5b893b72dc76 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:00.154953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d69497-20ba-4d89-a812-5b893b72dc76 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:00.154953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d69497-20ba-4d89-a812-5b893b72dc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:00.193884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-75d69497-20ba-4d89-a812-5b893b72dc76 None None] MFA Rules not processed for user `8194ea8a4cfa41288a6a603d155ab18e`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:00.195229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-75d69497-20ba-4d89-a812-5b893b72dc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:00.242477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d81d0-358a-41c4-9d30-6977949732ca service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:00.244543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f22d81d0-358a-41c4-9d30-6977949732ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:00.275246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d81d0-358a-41c4-9d30-6977949732ca service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:00.288395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:00.293088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:00.294843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:00.295291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] PATH_INFO: `/v3/projects/63ed4496631743f6af78f5e5bcf07d0b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:00.296902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ed4496631743f6af78f5e5bcf07d0b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:00.305026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:00.341744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:00.383393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 820/1647] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:00.408164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ed4496631743f6af78f5e5bcf07d0b', 'request_id': 'req-78f7f97f-8e26-48ee-8210-30e6bf81cf80'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.420437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ed4496631743f6af78f5e5bcf07d0b', 'request_id': 'req-78f7f97f-8e26-48ee-8210-30e6bf81cf80'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.432540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ed4496631743f6af78f5e5bcf07d0b', 'request_id': 'req-78f7f97f-8e26-48ee-8210-30e6bf81cf80'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.464412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] The token cache is being invalidate because project 63ed4496631743f6af78f5e5bcf07d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:00.466219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.468729 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-78f7f97f-8e26-48ee-8210-30e6bf81cf80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.475128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 828/1648] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:00 2022] DELETE /identity/v3/projects/63ed4496631743f6af78f5e5bcf07d0b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:00.479022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d69497-20ba-4d89-a812-5b893b72dc76 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:00.493573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d69497-20ba-4d89-a812-5b893b72dc76 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:00.645512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:00.646537 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:00.647554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:00.648041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] PATH_INFO: `/v3/users/42c47027b81b4b67afc24abe7e3bba30` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:00.649794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c47027b81b4b67afc24abe7e3bba30)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:00.652745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:00.797951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c47027b81b4b67afc24abe7e3bba30'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.816140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c47027b81b4b67afc24abe7e3bba30'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.826315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c47027b81b4b67afc24abe7e3bba30'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.845811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c47027b81b4b67afc24abe7e3bba30'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.849630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-206c8ac2-e1bf-43ea-b73b-3627b743efaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c47027b81b4b67afc24abe7e3bba30'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:00.889221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 821/1649] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:00 2022] DELETE /identity/v3/users/42c47027b81b4b67afc24abe7e3bba30 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:01.701645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ee7dc-48cb-4c1a-853c-3f8d36850600 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:01.702804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ee7dc-48cb-4c1a-853c-3f8d36850600 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:01.703282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ee7dc-48cb-4c1a-853c-3f8d36850600 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:01.705132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 829/1650] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:46:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:46:01.738540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e0d1-bad5-4de7-8060-f11c6618c356 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:01.744501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e0d1-bad5-4de7-8060-f11c6618c356 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:01.744991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e0d1-bad5-4de7-8060-f11c6618c356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:01.795582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-97f2e0d1-bad5-4de7-8060-f11c6618c356 None None] MFA Rules not processed for user `1485acc3d3e649168b8a1c69d0bbf12f`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:01.797101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-97f2e0d1-bad5-4de7-8060-f11c6618c356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:01.935881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:01.958707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 822/1651] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:46:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:01.981087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d483-d8c5-4d01-9390-2494ca3eae7f None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:01.982157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d483-d8c5-4d01-9390-2494ca3eae7f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:01.982646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d483-d8c5-4d01-9390-2494ca3eae7f None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:01.985691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 830/1652] 10.222.0.59 () {54 vars in 961 bytes} [Wed Aug 24 11:46:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:46:01.994761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40430a62-874d-4f82-97ee-2dd321a1af4e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:01.995605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40430a62-874d-4f82-97ee-2dd321a1af4e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:01.995910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40430a62-874d-4f82-97ee-2dd321a1af4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:02.029604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-40430a62-874d-4f82-97ee-2dd321a1af4e None None] MFA Rules not processed for user `1485acc3d3e649168b8a1c69d0bbf12f`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:02.031350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-40430a62-874d-4f82-97ee-2dd321a1af4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:02.040588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 823/1653] 10.222.0.59 () {58 vars in 1058 bytes} [Wed Aug 24 11:46:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:02.049224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d483-d8c5-4d01-9390-2494ca3eae7f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:02.070584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d483-d8c5-4d01-9390-2494ca3eae7f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:02.078812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90f6d-5b76-42ae-a025-eb24a152e4f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:02.079667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90f6d-5b76-42ae-a025-eb24a152e4f1 service placement] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:02.080179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90f6d-5b76-42ae-a025-eb24a152e4f1 service placement] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:02.080689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90f6d-5b76-42ae-a025-eb24a152e4f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:02.103948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90f6d-5b76-42ae-a025-eb24a152e4f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:02.106954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90f6d-5b76-42ae-a025-eb24a152e4f1 service placement] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:02.136379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 831/1654] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:02.404678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40430a62-874d-4f82-97ee-2dd321a1af4e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:02.406347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-40430a62-874d-4f82-97ee-2dd321a1af4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:02.441513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90f6d-5b76-42ae-a025-eb24a152e4f1 service placement] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:02.442979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-75e90f6d-5b76-42ae-a025-eb24a152e4f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:02.600922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40430a62-874d-4f82-97ee-2dd321a1af4e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:02.607342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90f6d-5b76-42ae-a025-eb24a152e4f1 service placement] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:02.611722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:02.612755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:02.613276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:02.617756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] PATH_INFO: `/v3/users/f8789f7c1cc847beafa70b9cebc06c73` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:02.621291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8789f7c1cc847beafa70b9cebc06c73)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:02.624550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:02.628430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:02.629455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:02.629939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:02.630435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] PATH_INFO: `/v3/projects/37f9ab8877c141d8abf5705666b1644c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:02.632865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f9ab8877c141d8abf5705666b1644c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:02.636898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:02.747717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:02.759986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8789f7c1cc847beafa70b9cebc06c73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.783119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8789f7c1cc847beafa70b9cebc06c73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.784327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8789f7c1cc847beafa70b9cebc06c73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.787888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f9ab8877c141d8abf5705666b1644c', 'request_id': 'req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.807213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f9ab8877c141d8abf5705666b1644c', 'request_id': 'req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.821156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8789f7c1cc847beafa70b9cebc06c73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.822403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f9ab8877c141d8abf5705666b1644c', 'request_id': 'req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.825706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a6afae6d-651d-4577-bde4-7b25d7289a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8789f7c1cc847beafa70b9cebc06c73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.855912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 824/1655] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:02 2022] DELETE /identity/v3/users/f8789f7c1cc847beafa70b9cebc06c73 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:02.856108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] The token cache is being invalidate because project 37f9ab8877c141d8abf5705666b1644c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:02.856108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.859633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6f73ee3f-128d-43ca-8bfb-cc5ec08334ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:02.863809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1ef8-f1e0-4024-9ec1-e29463e7d455 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:02.864145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1ef8-f1e0-4024-9ec1-e29463e7d455 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:02.866694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1ef8-f1e0-4024-9ec1-e29463e7d455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:02.867622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 832/1656] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:02 2022] DELETE /identity/v3/projects/37f9ab8877c141d8abf5705666b1644c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:02.874762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f7ab-7817-42a4-b7a3-592ee5d3da2c None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:02.875101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f7ab-7817-42a4-b7a3-592ee5d3da2c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:02.875300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f7ab-7817-42a4-b7a3-592ee5d3da2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:02.932058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6d0b1ef8-f1e0-4024-9ec1-e29463e7d455 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:02.933590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6d0b1ef8-f1e0-4024-9ec1-e29463e7d455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:02.935376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f1c5f7ab-7817-42a4-b7a3-592ee5d3da2c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:02.952963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f1c5f7ab-7817-42a4-b7a3-592ee5d3da2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:03.082550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 833/1657] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:03.099911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d758d8-fbae-430a-b51a-4d2b5aa3916b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:03.100441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d758d8-fbae-430a-b51a-4d2b5aa3916b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:03.100868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d758d8-fbae-430a-b51a-4d2b5aa3916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:03.111482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 825/1658] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:03.122981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-64d758d8-fbae-430a-b51a-4d2b5aa3916b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:03.124456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-64d758d8-fbae-430a-b51a-4d2b5aa3916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:03.133094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 834/1659] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:03.138349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1ef8-f1e0-4024-9ec1-e29463e7d455 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:03.154068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1ef8-f1e0-4024-9ec1-e29463e7d455 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:03.172266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fa8e0-e466-4ec7-9930-6bef33b769dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:03.175648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fa8e0-e466-4ec7-9930-6bef33b769dd admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:03.175995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fa8e0-e466-4ec7-9930-6bef33b769dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:03.176277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fa8e0-e466-4ec7-9930-6bef33b769dd admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:03.177337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fa8e0-e466-4ec7-9930-6bef33b769dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:03.177337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fa8e0-e466-4ec7-9930-6bef33b769dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:03.178463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d758d8-fbae-430a-b51a-4d2b5aa3916b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:03.178945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fa8e0-e466-4ec7-9930-6bef33b769dd admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:03.180589 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-64d758d8-fbae-430a-b51a-4d2b5aa3916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:03.204463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:03.216011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 826/1660] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:03.223731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fa8e0-e466-4ec7-9930-6bef33b769dd admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:03.262174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fa8e0-e466-4ec7-9930-6bef33b769dd admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:03.279280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618bcaf-7045-4c9c-9548-59ce4790a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:03.279917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618bcaf-7045-4c9c-9548-59ce4790a473 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:03.280202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618bcaf-7045-4c9c-9548-59ce4790a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:03.280475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618bcaf-7045-4c9c-9548-59ce4790a473 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:03.282384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618bcaf-7045-4c9c-9548-59ce4790a473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:03.285297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618bcaf-7045-4c9c-9548-59ce4790a473 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:03.366076 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 827/1661] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:03 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:03.368869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618bcaf-7045-4c9c-9548-59ce4790a473 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:03.409124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d758d8-fbae-430a-b51a-4d2b5aa3916b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:03.506125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba410f-e9b5-4db4-84ad-faf7b72553b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:03.506755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba410f-e9b5-4db4-84ad-faf7b72553b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:03.507218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba410f-e9b5-4db4-84ad-faf7b72553b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:03.507497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba410f-e9b5-4db4-84ad-faf7b72553b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:03.522047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618bcaf-7045-4c9c-9548-59ce4790a473 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:03.539051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba410f-e9b5-4db4-84ad-faf7b72553b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:03.545197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa11698-b1d8-416b-8c4d-1e451e0911e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:03.545833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa11698-b1d8-416b-8c4d-1e451e0911e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:03.546112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa11698-b1d8-416b-8c4d-1e451e0911e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:03.546386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa11698-b1d8-416b-8c4d-1e451e0911e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:03.547120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa11698-b1d8-416b-8c4d-1e451e0911e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:03.547561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba410f-e9b5-4db4-84ad-faf7b72553b1 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:03.551641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa11698-b1d8-416b-8c4d-1e451e0911e0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:03.568756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 835/1662] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:03.595294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 828/1663] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:03 2022] POST /identity/v3/users => generated 284 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:03.597301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba410f-e9b5-4db4-84ad-faf7b72553b1 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:03.612727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba410f-e9b5-4db4-84ad-faf7b72553b1 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:03.623514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a7ace-43fc-4128-84f5-8582d5f35e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:03.624522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a7ace-43fc-4128-84f5-8582d5f35e9b admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:03.625984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a7ace-43fc-4128-84f5-8582d5f35e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:03.626261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a7ace-43fc-4128-84f5-8582d5f35e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:03.626958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a7ace-43fc-4128-84f5-8582d5f35e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:03.632502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a7ace-43fc-4128-84f5-8582d5f35e9b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:03.664926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 836/1664] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:03.669956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa11698-b1d8-416b-8c4d-1e451e0911e0 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:03.681227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa11698-b1d8-416b-8c4d-1e451e0911e0 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:03.690111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54175e11-aef0-43df-9fd0-37f3505ee1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:03.691459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54175e11-aef0-43df-9fd0-37f3505ee1cf admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:03.691913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54175e11-aef0-43df-9fd0-37f3505ee1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:03.692514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54175e11-aef0-43df-9fd0-37f3505ee1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:03.693321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54175e11-aef0-43df-9fd0-37f3505ee1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:03.697115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54175e11-aef0-43df-9fd0-37f3505ee1cf admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:03.732609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 829/1665] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:03.732923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a7ace-43fc-4128-84f5-8582d5f35e9b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:03.738917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:03.747237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a7ace-43fc-4128-84f5-8582d5f35e9b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:03.759692 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9164b3-3d9b-4ef5-9c76-176064264f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:03.761462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9164b3-3d9b-4ef5-9c76-176064264f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:03.761462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9164b3-3d9b-4ef5-9c76-176064264f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:03.761875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9164b3-3d9b-4ef5-9c76-176064264f22 admin admin] PATH_INFO: `/v3/projects/78b078be4a994cccafae65732a48110b/users/023b9ced7dbf409ea17d83b4130001c2/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:03.801567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9164b3-3d9b-4ef5-9c76-176064264f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b078be4a994cccafae65732a48110b, user_id=023b9ced7dbf409ea17d83b4130001c2, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:03.807043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9164b3-3d9b-4ef5-9c76-176064264f22 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:03.868989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 837/1666] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:03 2022] PUT /identity/v3/projects/78b078be4a994cccafae65732a48110b/users/023b9ced7dbf409ea17d83b4130001c2/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:03.883357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c800f0-b99b-4c30-9f77-e0c07c6e635b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:03.884328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c800f0-b99b-4c30-9f77-e0c07c6e635b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:03.884798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c800f0-b99b-4c30-9f77-e0c07c6e635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:03.944164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-99c800f0-b99b-4c30-9f77-e0c07c6e635b None None] MFA Rules not processed for user `023b9ced7dbf409ea17d83b4130001c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:03.946547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-99c800f0-b99b-4c30-9f77-e0c07c6e635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:04.102406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 830/1667] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:04.106964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9164b3-3d9b-4ef5-9c76-176064264f22 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:04.243017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9164b3-3d9b-4ef5-9c76-176064264f22 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:04.250123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453824ce-0626-4b84-85e9-d759a49bba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:04.251149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453824ce-0626-4b84-85e9-d759a49bba80 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:04.251797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453824ce-0626-4b84-85e9-d759a49bba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:04.252290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453824ce-0626-4b84-85e9-d759a49bba80 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:04.253334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453824ce-0626-4b84-85e9-d759a49bba80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:04.256438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453824ce-0626-4b84-85e9-d759a49bba80 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:04.326076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 838/1668] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:04 2022] POST /identity/v3/projects => generated 365 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:04.330333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c800f0-b99b-4c30-9f77-e0c07c6e635b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:04.349725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c800f0-b99b-4c30-9f77-e0c07c6e635b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:04.484345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:04.515658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c7d8-23bd-4545-9e07-fe454502474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:04.516306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c7d8-23bd-4545-9e07-fe454502474e admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:04.516586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c7d8-23bd-4545-9e07-fe454502474e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:04.517482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747c7d8-23bd-4545-9e07-fe454502474e admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:04.517482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747c7d8-23bd-4545-9e07-fe454502474e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:04.519950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747c7d8-23bd-4545-9e07-fe454502474e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:04.576087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 831/1669] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:04 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:04.580050 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453824ce-0626-4b84-85e9-d759a49bba80 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:04.606399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453824ce-0626-4b84-85e9-d759a49bba80 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:04.612276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957801f-12a5-44cb-bc22-eb0970ae91f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:04.613261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957801f-12a5-44cb-bc22-eb0970ae91f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:04.613640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957801f-12a5-44cb-bc22-eb0970ae91f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:04.614155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957801f-12a5-44cb-bc22-eb0970ae91f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:04.614889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957801f-12a5-44cb-bc22-eb0970ae91f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:04.619297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957801f-12a5-44cb-bc22-eb0970ae91f6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:04.651286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 839/1670] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:04.657686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c7d8-23bd-4545-9e07-fe454502474e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:04.673063 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747c7d8-23bd-4545-9e07-fe454502474e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:04.685038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bd544-cc8f-444c-a1a2-1cb67398ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:04.685628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bd544-cc8f-444c-a1a2-1cb67398ca5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:04.685915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bd544-cc8f-444c-a1a2-1cb67398ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:04.686188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bd544-cc8f-444c-a1a2-1cb67398ca5b admin admin] PATH_INFO: `/v3/projects/c2573e4c61804e2baa581ebd209a26ab/users/2be0a31e98eb4f879ecd75771531d3b1/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:04.724722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bd544-cc8f-444c-a1a2-1cb67398ca5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2573e4c61804e2baa581ebd209a26ab, user_id=2be0a31e98eb4f879ecd75771531d3b1, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:04.727537 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bd544-cc8f-444c-a1a2-1cb67398ca5b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:04.756504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 832/1671] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:04 2022] PUT /identity/v3/projects/c2573e4c61804e2baa581ebd209a26ab/users/2be0a31e98eb4f879ecd75771531d3b1/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:04.760377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957801f-12a5-44cb-bc22-eb0970ae91f6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:04.779750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957801f-12a5-44cb-bc22-eb0970ae91f6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:04.904763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dab54f-4d62-45f6-991e-0937e312c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:04.905649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dab54f-4d62-45f6-991e-0937e312c530 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:04.905988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dab54f-4d62-45f6-991e-0937e312c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:04.906332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dab54f-4d62-45f6-991e-0937e312c530 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:04.907083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dab54f-4d62-45f6-991e-0937e312c530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:04.908785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dab54f-4d62-45f6-991e-0937e312c530 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:04.923329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 840/1672] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:04.927249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bd544-cc8f-444c-a1a2-1cb67398ca5b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:04.943927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bd544-cc8f-444c-a1a2-1cb67398ca5b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:04.956274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82032ec8-21a0-4748-bab6-bfbe69b11900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:04.958296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82032ec8-21a0-4748-bab6-bfbe69b11900 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:04.958421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82032ec8-21a0-4748-bab6-bfbe69b11900 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:04.958955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82032ec8-21a0-4748-bab6-bfbe69b11900 admin admin] PATH_INFO: `/v3/projects/c2573e4c61804e2baa581ebd209a26ab/users/2be0a31e98eb4f879ecd75771531d3b1/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:04.968488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82032ec8-21a0-4748-bab6-bfbe69b11900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2573e4c61804e2baa581ebd209a26ab, user_id=2be0a31e98eb4f879ecd75771531d3b1, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:04.972267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82032ec8-21a0-4748-bab6-bfbe69b11900 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:04.999836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 833/1673] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:04 2022] PUT /identity/v3/projects/c2573e4c61804e2baa581ebd209a26ab/users/2be0a31e98eb4f879ecd75771531d3b1/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:05.000346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b76a6-0d4d-4e5b-b104-58e7bba56ea4 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:05.000772 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b76a6-0d4d-4e5b-b104-58e7bba56ea4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:05.001052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b76a6-0d4d-4e5b-b104-58e7bba56ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:05.013645 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ed2fe-b018-4c4c-b1dc-7723aa9dfb00 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:05.013971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ed2fe-b018-4c4c-b1dc-7723aa9dfb00 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:05.014210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ed2fe-b018-4c4c-b1dc-7723aa9dfb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:05.051732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-392ed2fe-b018-4c4c-b1dc-7723aa9dfb00 None None] MFA Rules not processed for user `2be0a31e98eb4f879ecd75771531d3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:05.052964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-392ed2fe-b018-4c4c-b1dc-7723aa9dfb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:05.067627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ef1b76a6-0d4d-4e5b-b104-58e7bba56ea4 None None] MFA Rules not processed for user `2f4ede1576cf4669b3a3c46d30f62f73`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:05.071764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ef1b76a6-0d4d-4e5b-b104-58e7bba56ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:05.162172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:05.184147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 834/1674] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:05.191340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ed2fe-b018-4c4c-b1dc-7723aa9dfb00 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:05.193103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-392ed2fe-b018-4c4c-b1dc-7723aa9dfb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:05.239165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 841/1675] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:05.249541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b76a6-0d4d-4e5b-b104-58e7bba56ea4 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:05.251023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ef1b76a6-0d4d-4e5b-b104-58e7bba56ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:05.347995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ed2fe-b018-4c4c-b1dc-7723aa9dfb00 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:05.358360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507539b4-7bb3-4b78-8a0e-bfb29fd8db1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:05.359081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507539b4-7bb3-4b78-8a0e-bfb29fd8db1e service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:05.359367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507539b4-7bb3-4b78-8a0e-bfb29fd8db1e service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:05.359661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507539b4-7bb3-4b78-8a0e-bfb29fd8db1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:05.389997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507539b4-7bb3-4b78-8a0e-bfb29fd8db1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:05.396891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507539b4-7bb3-4b78-8a0e-bfb29fd8db1e service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:05.442597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 835/1676] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:05.471438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b76a6-0d4d-4e5b-b104-58e7bba56ea4 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:05.487100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80930f8-c759-42dc-9d64-e0147a4f9fed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:05.490007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80930f8-c759-42dc-9d64-e0147a4f9fed service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:05.490688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80930f8-c759-42dc-9d64-e0147a4f9fed service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:05.491822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80930f8-c759-42dc-9d64-e0147a4f9fed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:05.508502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80930f8-c759-42dc-9d64-e0147a4f9fed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:05.510318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80930f8-c759-42dc-9d64-e0147a4f9fed service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:05.527423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 842/1677] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:05.590201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507539b4-7bb3-4b78-8a0e-bfb29fd8db1e service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:05.606486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507539b4-7bb3-4b78-8a0e-bfb29fd8db1e service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:05.624053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5db09-2b80-4813-b461-9b430338c28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:05.626036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5db09-2b80-4813-b461-9b430338c28f service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:05.626410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5db09-2b80-4813-b461-9b430338c28f service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:05.627590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5db09-2b80-4813-b461-9b430338c28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:05.733296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:05.827744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5db09-2b80-4813-b461-9b430338c28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:05.829480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5db09-2b80-4813-b461-9b430338c28f service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:05.852810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 836/1678] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:06.771004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892feb5-360f-4a15-9fc4-afedde61b4f9 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:06.771569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892feb5-360f-4a15-9fc4-afedde61b4f9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:06.771569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892feb5-360f-4a15-9fc4-afedde61b4f9 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:06.773323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 843/1679] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:46:06.797292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe99db-a75a-4299-a75d-d9ecba131d1f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:06.798420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe99db-a75a-4299-a75d-d9ecba131d1f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:06.799414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe99db-a75a-4299-a75d-d9ecba131d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:06.842942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-11fe99db-a75a-4299-a75d-d9ecba131d1f None None] MFA Rules not processed for user `1485acc3d3e649168b8a1c69d0bbf12f`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:06.844557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-11fe99db-a75a-4299-a75d-d9ecba131d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:07.033452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 837/1680] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:46:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:07.223217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892feb5-360f-4a15-9fc4-afedde61b4f9 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:07.224992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f892feb5-360f-4a15-9fc4-afedde61b4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:07.246452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe99db-a75a-4299-a75d-d9ecba131d1f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:07.247937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-11fe99db-a75a-4299-a75d-d9ecba131d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:07.272528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892feb5-360f-4a15-9fc4-afedde61b4f9 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:07.297181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7132f-8d7d-4469-b920-5a2bbec66818 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:07.298317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7132f-8d7d-4469-b920-5a2bbec66818 service placement] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:07.298317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7132f-8d7d-4469-b920-5a2bbec66818 service placement] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:07.298490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7132f-8d7d-4469-b920-5a2bbec66818 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:07.332054 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7132f-8d7d-4469-b920-5a2bbec66818 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:07.333696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7132f-8d7d-4469-b920-5a2bbec66818 service placement] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:07.374491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 844/1681] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:07.400927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7132f-8d7d-4469-b920-5a2bbec66818 service placement] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:07.403690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-13a7132f-8d7d-4469-b920-5a2bbec66818 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:07.455924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe99db-a75a-4299-a75d-d9ecba131d1f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:07.470368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:07.471154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:07.471568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:07.472053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] PATH_INFO: `/v3/users/10ff926f66584d139a90cd544a02795a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:07.475460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ff926f66584d139a90cd544a02795a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:07.477546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:07.552169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7132f-8d7d-4469-b920-5a2bbec66818 service placement] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:07.560945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:07.561658 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:07.561941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:07.562262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] PATH_INFO: `/v3/projects/f61b8d48123c4dfdb4f3fa1977d38887` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:07.576225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61b8d48123c4dfdb4f3fa1977d38887)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:07.580961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:07.587421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ff926f66584d139a90cd544a02795a'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.602284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ff926f66584d139a90cd544a02795a'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.604528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ff926f66584d139a90cd544a02795a'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.617632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:07.636140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ff926f66584d139a90cd544a02795a'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.641474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b974bd1f-9fe8-4294-9951-b35d5c06e7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ff926f66584d139a90cd544a02795a'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.669383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 838/1682] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:07 2022] DELETE /identity/v3/users/10ff926f66584d139a90cd544a02795a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:07.680765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61b8d48123c4dfdb4f3fa1977d38887', 'request_id': 'req-ad9d24d2-524d-415d-a565-140f0582f11d'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.682946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:07.688086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61b8d48123c4dfdb4f3fa1977d38887', 'request_id': 'req-ad9d24d2-524d-415d-a565-140f0582f11d'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.694478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61b8d48123c4dfdb4f3fa1977d38887', 'request_id': 'req-ad9d24d2-524d-415d-a565-140f0582f11d'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.709204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] The token cache is being invalidate because project f61b8d48123c4dfdb4f3fa1977d38887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:07.709631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.710407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ad9d24d2-524d-415d-a565-140f0582f11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:07.714571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 845/1683] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:07 2022] DELETE /identity/v3/projects/f61b8d48123c4dfdb4f3fa1977d38887 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:07.719354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb01ff2-e945-44b3-a532-d45d71aa61a1 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:07.719644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb01ff2-e945-44b3-a532-d45d71aa61a1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:07.719980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb01ff2-e945-44b3-a532-d45d71aa61a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:07.768634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6eb01ff2-e945-44b3-a532-d45d71aa61a1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:07.773554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6eb01ff2-e945-44b3-a532-d45d71aa61a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:07.904289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 839/1684] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:07.912136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839e4f0-4494-4fb0-b011-25f91c48cf30 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:07.912966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839e4f0-4494-4fb0-b011-25f91c48cf30 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:07.913439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839e4f0-4494-4fb0-b011-25f91c48cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:07.955370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b839e4f0-4494-4fb0-b011-25f91c48cf30 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:07.961322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b839e4f0-4494-4fb0-b011-25f91c48cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:07.980832 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 846/1685] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:07.984923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb01ff2-e945-44b3-a532-d45d71aa61a1 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:07.995544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb01ff2-e945-44b3-a532-d45d71aa61a1 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:08.015580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c27e-2bf7-4925-ae05-7b0bea677182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:08.016220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c27e-2bf7-4925-ae05-7b0bea677182 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:08.016504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c27e-2bf7-4925-ae05-7b0bea677182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:08.016781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c27e-2bf7-4925-ae05-7b0bea677182 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:08.019946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c27e-2bf7-4925-ae05-7b0bea677182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:08.019946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c27e-2bf7-4925-ae05-7b0bea677182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:08.019946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c27e-2bf7-4925-ae05-7b0bea677182 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:08.070587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 840/1686] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:08.071917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839e4f0-4494-4fb0-b011-25f91c48cf30 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:08.100072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839e4f0-4494-4fb0-b011-25f91c48cf30 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:08.113228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887846d1-d1ed-445a-b989-f9d8f207ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:08.114439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887846d1-d1ed-445a-b989-f9d8f207ffa7 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:08.118352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887846d1-d1ed-445a-b989-f9d8f207ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:08.126573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887846d1-d1ed-445a-b989-f9d8f207ffa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:08.132459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887846d1-d1ed-445a-b989-f9d8f207ffa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:08.135308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887846d1-d1ed-445a-b989-f9d8f207ffa7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:08.232918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 847/1687] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:08 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:08.237236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c27e-2bf7-4925-ae05-7b0bea677182 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:08.258100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c27e-2bf7-4925-ae05-7b0bea677182 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:08.442123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60836-47e4-4c76-ba5f-00025943e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:08.442556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60836-47e4-4c76-ba5f-00025943e344 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:08.442896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60836-47e4-4c76-ba5f-00025943e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:08.443868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f60836-47e4-4c76-ba5f-00025943e344 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:08.445503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60836-47e4-4c76-ba5f-00025943e344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:08.453326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f60836-47e4-4c76-ba5f-00025943e344 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:08.520019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887846d1-d1ed-445a-b989-f9d8f207ffa7 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:08.531288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 841/1688] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:08 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:08.536484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887846d1-d1ed-445a-b989-f9d8f207ffa7 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:08.547818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c232dd-5f99-477d-869f-d59edd8fa339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:08.548507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c232dd-5f99-477d-869f-d59edd8fa339 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:08.549233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c232dd-5f99-477d-869f-d59edd8fa339 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:08.549520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c232dd-5f99-477d-869f-d59edd8fa339 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:08.553122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c232dd-5f99-477d-869f-d59edd8fa339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:08.555098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c232dd-5f99-477d-869f-d59edd8fa339 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:08.581409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60836-47e4-4c76-ba5f-00025943e344 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:08.593346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 848/1689] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:08.597693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f60836-47e4-4c76-ba5f-00025943e344 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:08.604228 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbd90f-d500-4813-b0dd-ba4c5abc94b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:08.605005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbd90f-d500-4813-b0dd-ba4c5abc94b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:08.605378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbd90f-d500-4813-b0dd-ba4c5abc94b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:08.605666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbd90f-d500-4813-b0dd-ba4c5abc94b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:08.606473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbd90f-d500-4813-b0dd-ba4c5abc94b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:08.608688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbd90f-d500-4813-b0dd-ba4c5abc94b7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:08.648095 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c232dd-5f99-477d-869f-d59edd8fa339 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:08.657239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 842/1690] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:08.662650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbd90f-d500-4813-b0dd-ba4c5abc94b7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:08.670690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c232dd-5f99-477d-869f-d59edd8fa339 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:08.671678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6bbbd90f-d500-4813-b0dd-ba4c5abc94b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:08.685607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f558e51-f0c0-42c1-873e-eea761942129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:08.688380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f558e51-f0c0-42c1-873e-eea761942129 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:08.688698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f558e51-f0c0-42c1-873e-eea761942129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:08.689063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f558e51-f0c0-42c1-873e-eea761942129 admin admin] PATH_INFO: `/v3/projects/9c68221c4dc142adb832c8606df6e557/users/6144036cc3c241fe8b352302641add23/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:08.702119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbd90f-d500-4813-b0dd-ba4c5abc94b7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:08.709897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:08.712044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:08.712349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:08.712628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] PATH_INFO: `/v3/projects/61c6260fd0764fdc9cfc7f3c079a9d5e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:08.716044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f558e51-f0c0-42c1-873e-eea761942129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c68221c4dc142adb832c8606df6e557, user_id=6144036cc3c241fe8b352302641add23, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:08.716413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c6260fd0764fdc9cfc7f3c079a9d5e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:08.718862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: WARNING py.warnings [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:46:08.718862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: warnings.warn(msg) Aug 24 11:46:08.718862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: Aug 24 11:46:08.725156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:08.727120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f558e51-f0c0-42c1-873e-eea761942129 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:08.752627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 849/1691] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:08 2022] PUT /identity/v3/projects/9c68221c4dc142adb832c8606df6e557/users/6144036cc3c241fe8b352302641add23/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:08.764911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f2479-533a-43ee-9d06-000d0946f5fa None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:08.767927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f2479-533a-43ee-9d06-000d0946f5fa None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:08.767927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f2479-533a-43ee-9d06-000d0946f5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:08.840664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:08.870881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-246f2479-533a-43ee-9d06-000d0946f5fa None None] MFA Rules not processed for user `6144036cc3c241fe8b352302641add23`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:08.872957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-246f2479-533a-43ee-9d06-000d0946f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:08.879890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c6260fd0764fdc9cfc7f3c079a9d5e', 'request_id': 'req-584abd22-b452-45d9-84c7-7ff7e0b6477b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:08.899760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c6260fd0764fdc9cfc7f3c079a9d5e', 'request_id': 'req-584abd22-b452-45d9-84c7-7ff7e0b6477b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:08.917716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c6260fd0764fdc9cfc7f3c079a9d5e', 'request_id': 'req-584abd22-b452-45d9-84c7-7ff7e0b6477b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:08.992613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] The token cache is being invalidate because project 61c6260fd0764fdc9cfc7f3c079a9d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:08.993341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:08.995683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:09.006188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 843/1692] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:08 2022] DELETE /identity/v3/projects/61c6260fd0764fdc9cfc7f3c079a9d5e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:09.032876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:09.036937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:09.059845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 850/1693] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:09.072854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f2479-533a-43ee-9d06-000d0946f5fa None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:09.075305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-246f2479-533a-43ee-9d06-000d0946f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:09.196957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f2479-533a-43ee-9d06-000d0946f5fa None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:09.215601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b450e4-5328-4fc8-8e77-2cf8baf6648b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:09.216242 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b450e4-5328-4fc8-8e77-2cf8baf6648b service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:09.216521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b450e4-5328-4fc8-8e77-2cf8baf6648b service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:09.216819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b450e4-5328-4fc8-8e77-2cf8baf6648b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:09.217734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584abd22-b452-45d9-84c7-7ff7e0b6477b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:09.230250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:09.231886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:09.235372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:09.235780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] PATH_INFO: `/v3/users/8194ea8a4cfa41288a6a603d155ab18e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:09.238902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8194ea8a4cfa41288a6a603d155ab18e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:09.243707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:09.248053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b450e4-5328-4fc8-8e77-2cf8baf6648b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:09.249545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b450e4-5328-4fc8-8e77-2cf8baf6648b service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:09.277232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 851/1694] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:09.357253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8194ea8a4cfa41288a6a603d155ab18e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:09.367450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8194ea8a4cfa41288a6a603d155ab18e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:09.368467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8194ea8a4cfa41288a6a603d155ab18e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:09.409267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8194ea8a4cfa41288a6a603d155ab18e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:09.410136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fc6fb52f-cdbd-4418-89ea-60f8fc32f964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8194ea8a4cfa41288a6a603d155ab18e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:09.429875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 844/1695] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:09 2022] DELETE /identity/v3/users/8194ea8a4cfa41288a6a603d155ab18e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:09.457864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb275b1-cde1-4bf9-83b7-0146603eb335 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:09.458227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb275b1-cde1-4bf9-83b7-0146603eb335 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:09.458514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb275b1-cde1-4bf9-83b7-0146603eb335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:09.499976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:09.520648 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-edb275b1-cde1-4bf9-83b7-0146603eb335 None None] MFA Rules not processed for user `8e96e106cdd14b898253b1c90fb582da`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:09.521912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-edb275b1-cde1-4bf9-83b7-0146603eb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:09.718240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b48650-1dd1-496e-a6f7-b189f5b3e795 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:09.718521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b48650-1dd1-496e-a6f7-b189f5b3e795 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:09.718823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b48650-1dd1-496e-a6f7-b189f5b3e795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:09.722608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 852/1696] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:09.770275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f6b48650-1dd1-496e-a6f7-b189f5b3e795 None None] MFA Rules not processed for user `8e96e106cdd14b898253b1c90fb582da`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:09.772111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f6b48650-1dd1-496e-a6f7-b189f5b3e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:09.806558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 845/1697] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:09.821105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb275b1-cde1-4bf9-83b7-0146603eb335 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:09.823802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-edb275b1-cde1-4bf9-83b7-0146603eb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:10.082608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb275b1-cde1-4bf9-83b7-0146603eb335 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:10.099028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f340c-f951-405f-8d54-e3f2d8c14ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:10.099028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f340c-f951-405f-8d54-e3f2d8c14ab5 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:10.099028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f340c-f951-405f-8d54-e3f2d8c14ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:10.099028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f340c-f951-405f-8d54-e3f2d8c14ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:10.117805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f340c-f951-405f-8d54-e3f2d8c14ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:10.124422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f340c-f951-405f-8d54-e3f2d8c14ab5 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:10.151780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 853/1698] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:11.337460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b48650-1dd1-496e-a6f7-b189f5b3e795 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:11.340138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f6b48650-1dd1-496e-a6f7-b189f5b3e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:11.445464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3c0f5-2d15-463c-a329-e82b78ef3735 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:11.446026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3c0f5-2d15-463c-a329-e82b78ef3735 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:11.446026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3c0f5-2d15-463c-a329-e82b78ef3735 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:11.447398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 854/1699] 10.222.0.59 () {54 vars in 912 bytes} [Wed Aug 24 11:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:46:11.459571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca7a69-6a73-4c83-878a-dd2fc0fd34b9 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:11.459862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca7a69-6a73-4c83-878a-dd2fc0fd34b9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:11.460357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca7a69-6a73-4c83-878a-dd2fc0fd34b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:11.502034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:11.583781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f0ca7a69-6a73-4c83-878a-dd2fc0fd34b9 None None] MFA Rules not processed for user `9b072d5669e34ad5b7b52a4a6e26700b`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:11.585213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f0ca7a69-6a73-4c83-878a-dd2fc0fd34b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:11.586821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b48650-1dd1-496e-a6f7-b189f5b3e795 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:11.605702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:11.609101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:11.610358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:11.611477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] PATH_INFO: `/v3/projects/e1167856f37c428c922ee5429c5471f8` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:11.627463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1167856f37c428c922ee5429c5471f8)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:11.634319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:11.757859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 855/1700] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:46:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:11.912354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1167856f37c428c922ee5429c5471f8', 'request_id': 'req-b2b1c2be-8b72-43be-88e7-5c6863269810'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:11.941213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1167856f37c428c922ee5429c5471f8', 'request_id': 'req-b2b1c2be-8b72-43be-88e7-5c6863269810'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:11.953976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca7a69-6a73-4c83-878a-dd2fc0fd34b9 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:11.955501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f0ca7a69-6a73-4c83-878a-dd2fc0fd34b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:11.975532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1167856f37c428c922ee5429c5471f8', 'request_id': 'req-b2b1c2be-8b72-43be-88e7-5c6863269810'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:11.979650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca7a69-6a73-4c83-878a-dd2fc0fd34b9 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:12.031902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] The token cache is being invalidate because project e1167856f37c428c922ee5429c5471f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:12.032199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:12.038275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b1c2be-8b72-43be-88e7-5c6863269810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:12.038682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:12.048271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 846/1701] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:11 2022] DELETE /identity/v3/projects/e1167856f37c428c922ee5429c5471f8 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:12.054587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952d58-6978-4573-83e5-edd5669bb552 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:12.054909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952d58-6978-4573-83e5-edd5669bb552 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:12.058759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952d58-6978-4573-83e5-edd5669bb552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:12.165517 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-7e952d58-6978-4573-83e5-edd5669bb552 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:12.168074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7e952d58-6978-4573-83e5-edd5669bb552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:12.168598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65b28d-08d7-4326-99d4-989e981f857a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:12.169254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b28d-08d7-4326-99d4-989e981f857a service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:12.169536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b28d-08d7-4326-99d4-989e981f857a service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:12.169812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b28d-08d7-4326-99d4-989e981f857a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:12.180273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7d65b28d-08d7-4326-99d4-989e981f857a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:12.225880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65b28d-08d7-4326-99d4-989e981f857a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:12.227724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65b28d-08d7-4326-99d4-989e981f857a service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:12.246113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 856/1702] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:12.318656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 847/1703] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:12.327922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c1a40-9f22-42be-9877-571ededa67c8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:12.328293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c1a40-9f22-42be-9877-571ededa67c8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:12.328647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c1a40-9f22-42be-9877-571ededa67c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:12.356763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a44c1a40-9f22-42be-9877-571ededa67c8 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:12.359065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a44c1a40-9f22-42be-9877-571ededa67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:12.374795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e952d58-6978-4573-83e5-edd5669bb552 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:12.382217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 857/1704] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:12.387945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e952d58-6978-4573-83e5-edd5669bb552 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:12.393362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c824426-3645-45b0-9f11-4f1c1091cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:12.394727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c824426-3645-45b0-9f11-4f1c1091cec0 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:12.395259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c824426-3645-45b0-9f11-4f1c1091cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:12.395632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c824426-3645-45b0-9f11-4f1c1091cec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:12.396526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c824426-3645-45b0-9f11-4f1c1091cec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:12.396926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c824426-3645-45b0-9f11-4f1c1091cec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:12.399846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c824426-3645-45b0-9f11-4f1c1091cec0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:12.439357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c1a40-9f22-42be-9877-571ededa67c8 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:12.458460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 848/1705] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:12.460158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bce285-951c-431d-bee6-311fdc6bb3b7 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:12.460449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bce285-951c-431d-bee6-311fdc6bb3b7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:12.460725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bce285-951c-431d-bee6-311fdc6bb3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:12.461643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c1a40-9f22-42be-9877-571ededa67c8 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:12.473010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34796c1-1160-4279-9ec4-e0c4bbdf8156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:12.473703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34796c1-1160-4279-9ec4-e0c4bbdf8156 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:12.474944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34796c1-1160-4279-9ec4-e0c4bbdf8156 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:12.476039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34796c1-1160-4279-9ec4-e0c4bbdf8156 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:12.476766 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34796c1-1160-4279-9ec4-e0c4bbdf8156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:12.483227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34796c1-1160-4279-9ec4-e0c4bbdf8156 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:12.536406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-80bce285-951c-431d-bee6-311fdc6bb3b7 None None] MFA Rules not processed for user `d9c69e18847a40379daf843e87dad68b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:12.537860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-80bce285-951c-431d-bee6-311fdc6bb3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:12.552330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 858/1706] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:12 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:12.559192 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34796c1-1160-4279-9ec4-e0c4bbdf8156 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:12.679179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:12.723937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 849/1707] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:12.735381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804db18-3ed6-48ad-b1ab-fb20cab19f8b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:12.735381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804db18-3ed6-48ad-b1ab-fb20cab19f8b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:12.735381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804db18-3ed6-48ad-b1ab-fb20cab19f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:12.745036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34796c1-1160-4279-9ec4-e0c4bbdf8156 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:12.767490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dae47-6470-4bad-89e9-1cbaa63e05c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:12.768181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dae47-6470-4bad-89e9-1cbaa63e05c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:12.768467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dae47-6470-4bad-89e9-1cbaa63e05c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:12.768740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dae47-6470-4bad-89e9-1cbaa63e05c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:12.769642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dae47-6470-4bad-89e9-1cbaa63e05c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:12.777728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dae47-6470-4bad-89e9-1cbaa63e05c7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:12.778065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b804db18-3ed6-48ad-b1ab-fb20cab19f8b None None] MFA Rules not processed for user `d9c69e18847a40379daf843e87dad68b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:12.779507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b804db18-3ed6-48ad-b1ab-fb20cab19f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:12.854152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 859/1708] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:12 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:12.858282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dae47-6470-4bad-89e9-1cbaa63e05c7 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:12.878569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dae47-6470-4bad-89e9-1cbaa63e05c7 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:12.892225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36165-9574-4a76-b731-6c48580b5d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:12.892904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36165-9574-4a76-b731-6c48580b5d33 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:12.893187 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36165-9574-4a76-b731-6c48580b5d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:12.893462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36165-9574-4a76-b731-6c48580b5d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:12.894118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a36165-9574-4a76-b731-6c48580b5d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:12.898570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a36165-9574-4a76-b731-6c48580b5d33 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:12.922388 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 850/1709] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:12.935911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804db18-3ed6-48ad-b1ab-fb20cab19f8b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:12.937917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b804db18-3ed6-48ad-b1ab-fb20cab19f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:12.962946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 860/1710] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:46:12.966223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36165-9574-4a76-b731-6c48580b5d33 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:13.034051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36165-9574-4a76-b731-6c48580b5d33 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:13.072253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c487b-a5db-4785-b652-e6e9fbc77ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:13.072890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c487b-a5db-4785-b652-e6e9fbc77ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:13.073166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c487b-a5db-4785-b652-e6e9fbc77ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:13.073544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c487b-a5db-4785-b652-e6e9fbc77ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:13.081823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c487b-a5db-4785-b652-e6e9fbc77ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:13.084503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c487b-a5db-4785-b652-e6e9fbc77ed9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:13.159146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 861/1711] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:13.160446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c487b-a5db-4785-b652-e6e9fbc77ed9 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:13.197821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c487b-a5db-4785-b652-e6e9fbc77ed9 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:13.215632 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a19b-7aec-4461-a538-929bf08fd9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:13.218655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a19b-7aec-4461-a538-929bf08fd9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:13.223053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a19b-7aec-4461-a538-929bf08fd9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:13.223505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a19b-7aec-4461-a538-929bf08fd9ee admin admin] PATH_INFO: `/v3/projects/d2cb9762153947348143e6f442422d73/users/34ce230bd802449a9bd0560a09cfdf05/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:13.272659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402a19b-7aec-4461-a538-929bf08fd9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2cb9762153947348143e6f442422d73, user_id=34ce230bd802449a9bd0560a09cfdf05, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:13.284002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402a19b-7aec-4461-a538-929bf08fd9ee admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:13.289609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804db18-3ed6-48ad-b1ab-fb20cab19f8b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:13.306528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7c5a1-3ab6-450d-89d7-59c7097fcda8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:13.309403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7c5a1-3ab6-450d-89d7-59c7097fcda8 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:13.310222 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7c5a1-3ab6-450d-89d7-59c7097fcda8 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:13.310914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7c5a1-3ab6-450d-89d7-59c7097fcda8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:13.341579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 862/1712] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:13 2022] PUT /identity/v3/projects/d2cb9762153947348143e6f442422d73/users/34ce230bd802449a9bd0560a09cfdf05/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:13.341579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a19b-7aec-4461-a538-929bf08fd9ee admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:13.345093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6402a19b-7aec-4461-a538-929bf08fd9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:13.352094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7c5a1-3ab6-450d-89d7-59c7097fcda8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:13.354725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7c5a1-3ab6-450d-89d7-59c7097fcda8 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:13.367870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 851/1713] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:13.369601 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d699447-15a0-4724-b6c5-48406ca02927 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:13.369971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d699447-15a0-4724-b6c5-48406ca02927 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:13.370268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d699447-15a0-4724-b6c5-48406ca02927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:13.418185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3d699447-15a0-4724-b6c5-48406ca02927 None None] MFA Rules not processed for user `34ce230bd802449a9bd0560a09cfdf05`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:13.422077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3d699447-15a0-4724-b6c5-48406ca02927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:13.556671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:13.626148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a19b-7aec-4461-a538-929bf08fd9ee admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:13.633232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a81e9-21c1-411f-bb58-6baedf00236f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:13.633845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a81e9-21c1-411f-bb58-6baedf00236f service placement] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:13.634124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a81e9-21c1-411f-bb58-6baedf00236f service placement] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:13.634399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a81e9-21c1-411f-bb58-6baedf00236f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:13.637178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0c9a81e9-21c1-411f-bb58-6baedf00236f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:13.641122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 852/1714] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:13.642154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d699447-15a0-4724-b6c5-48406ca02927 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:13.649239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3d699447-15a0-4724-b6c5-48406ca02927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:13.672031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:13.700104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a81e9-21c1-411f-bb58-6baedf00236f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:13.704297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a81e9-21c1-411f-bb58-6baedf00236f service placement] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:13.734552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 863/1715] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:13.736271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a81e9-21c1-411f-bb58-6baedf00236f service placement] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:13.862116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d699447-15a0-4724-b6c5-48406ca02927 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:13.890802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:13.891482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:13.891763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:13.892039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] PATH_INFO: `/v3/users/023b9ced7dbf409ea17d83b4130001c2` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:13.897481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=023b9ced7dbf409ea17d83b4130001c2)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:13.899506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:13.918535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a81e9-21c1-411f-bb58-6baedf00236f service placement] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:13.945181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4308c-1bb7-4c45-ad1b-0844884e7905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:13.945999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4308c-1bb7-4c45-ad1b-0844884e7905 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:13.946688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4308c-1bb7-4c45-ad1b-0844884e7905 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:13.946688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4308c-1bb7-4c45-ad1b-0844884e7905 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:13.947455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4308c-1bb7-4c45-ad1b-0844884e7905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:13.949827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4308c-1bb7-4c45-ad1b-0844884e7905 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:14.026440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 864/1716] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:13 2022] POST /identity/v3/projects => generated 371 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:14.047107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9351674-85f2-478c-8713-9ab9c839d63e None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:14.047402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9351674-85f2-478c-8713-9ab9c839d63e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:14.047688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9351674-85f2-478c-8713-9ab9c839d63e None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:14.052279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023b9ced7dbf409ea17d83b4130001c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:14.054762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 865/1717] 10.222.0.59 () {54 vars in 912 bytes} [Wed Aug 24 11:46:14 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:46:14.061746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9351674-85f2-478c-8713-9ab9c839d63e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:14.083153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023b9ced7dbf409ea17d83b4130001c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:14.086149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023b9ced7dbf409ea17d83b4130001c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:14.132662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023b9ced7dbf409ea17d83b4130001c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:14.133808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-04968dd6-826c-45a6-89f7-f3d5c48244f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023b9ced7dbf409ea17d83b4130001c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:14.167578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 853/1718] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:13 2022] DELETE /identity/v3/users/023b9ced7dbf409ea17d83b4130001c2 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:14.172364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a732acf-b702-4aaa-a17a-fc47126a67e5 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:14.173194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a732acf-b702-4aaa-a17a-fc47126a67e5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:14.174035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a732acf-b702-4aaa-a17a-fc47126a67e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:14.227404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-6a732acf-b702-4aaa-a17a-fc47126a67e5 None None] MFA Rules not processed for user `9b072d5669e34ad5b7b52a4a6e26700b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:14.230744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6a732acf-b702-4aaa-a17a-fc47126a67e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:14.295277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9351674-85f2-478c-8713-9ab9c839d63e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:14.384706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 854/1719] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:46:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:14.389847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62ac97-0382-497c-9fad-c7c62cd5267e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:14.390865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62ac97-0382-497c-9fad-c7c62cd5267e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:14.392100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62ac97-0382-497c-9fad-c7c62cd5267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:14.434357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ed62ac97-0382-497c-9fad-c7c62cd5267e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:14.436694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ed62ac97-0382-497c-9fad-c7c62cd5267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:14.531791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be922400-0e04-495e-aa38-49d29f1255d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:14.532894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be922400-0e04-495e-aa38-49d29f1255d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:14.532894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be922400-0e04-495e-aa38-49d29f1255d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:14.533093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be922400-0e04-495e-aa38-49d29f1255d1 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:14.533682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be922400-0e04-495e-aa38-49d29f1255d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:14.536338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be922400-0e04-495e-aa38-49d29f1255d1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:14.555603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:14.572508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:14.589657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 866/1720] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:14 2022] POST /identity/v3/users => generated 292 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:14.597593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be922400-0e04-495e-aa38-49d29f1255d1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:14.600583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-be922400-0e04-495e-aa38-49d29f1255d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:14.638885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be922400-0e04-495e-aa38-49d29f1255d1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:14.649494 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d030923-4bd1-48d6-96bd-d19b15bae2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:14.650163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d030923-4bd1-48d6-96bd-d19b15bae2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:14.650543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d030923-4bd1-48d6-96bd-d19b15bae2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:14.652191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d030923-4bd1-48d6-96bd-d19b15bae2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:14.684721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d030923-4bd1-48d6-96bd-d19b15bae2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:14.684721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d030923-4bd1-48d6-96bd-d19b15bae2f5 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:14.711392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 867/1721] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:14.714516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d030923-4bd1-48d6-96bd-d19b15bae2f5 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:14.719752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7d030923-4bd1-48d6-96bd-d19b15bae2f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:14.725256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 855/1722] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:14.751346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62ac97-0382-497c-9fad-c7c62cd5267e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:14.754516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d030923-4bd1-48d6-96bd-d19b15bae2f5 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:14.764273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62ac97-0382-497c-9fad-c7c62cd5267e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:14.770417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602a469-af18-4a59-b59f-0ec7fc1d5858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:14.771104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602a469-af18-4a59-b59f-0ec7fc1d5858 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:14.771507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602a469-af18-4a59-b59f-0ec7fc1d5858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:14.771789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602a469-af18-4a59-b59f-0ec7fc1d5858 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:14.772442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602a469-af18-4a59-b59f-0ec7fc1d5858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:14.774084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602a469-af18-4a59-b59f-0ec7fc1d5858 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:14.777536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cdffd-f331-4aa5-930f-d92bbd614d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:14.780515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cdffd-f331-4aa5-930f-d92bbd614d28 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:14.780684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cdffd-f331-4aa5-930f-d92bbd614d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:14.780868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cdffd-f331-4aa5-930f-d92bbd614d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:14.802404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 868/1723] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:14.808111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602a469-af18-4a59-b59f-0ec7fc1d5858 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:14.814121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cdffd-f331-4aa5-930f-d92bbd614d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:14.815761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cdffd-f331-4aa5-930f-d92bbd614d28 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:14.832896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602a469-af18-4a59-b59f-0ec7fc1d5858 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:14.841803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 856/1724] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:14.845128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedce73-393f-4404-b1b7-53e19bfeae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:14.848303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedce73-393f-4404-b1b7-53e19bfeae59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:14.848619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedce73-393f-4404-b1b7-53e19bfeae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:14.848904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedce73-393f-4404-b1b7-53e19bfeae59 admin admin] PATH_INFO: `/v3/projects/f9aa537dfbf947b199b8fb3846cf0c37/users/cc4a46c0aea04e08b8e613479f1a2158/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:14.919883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedce73-393f-4404-b1b7-53e19bfeae59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9aa537dfbf947b199b8fb3846cf0c37, user_id=cc4a46c0aea04e08b8e613479f1a2158, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:14.922676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedce73-393f-4404-b1b7-53e19bfeae59 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:14.957936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 869/1725] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:14 2022] PUT /identity/v3/projects/f9aa537dfbf947b199b8fb3846cf0c37/users/cc4a46c0aea04e08b8e613479f1a2158/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:14.959271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cdffd-f331-4aa5-930f-d92bbd614d28 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:14.982001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cdffd-f331-4aa5-930f-d92bbd614d28 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:15.245627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b371a-1231-40e6-8fce-7967fa35f3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:15.246936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b371a-1231-40e6-8fce-7967fa35f3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:15.247435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b371a-1231-40e6-8fce-7967fa35f3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:15.248106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b371a-1231-40e6-8fce-7967fa35f3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:15.255602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b371a-1231-40e6-8fce-7967fa35f3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:15.273284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b371a-1231-40e6-8fce-7967fa35f3f8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:15.304830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 857/1726] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:15.309593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedce73-393f-4404-b1b7-53e19bfeae59 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:15.325380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedce73-393f-4404-b1b7-53e19bfeae59 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:15.333930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9517d-9b68-4773-a191-f4432a908a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:15.335171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9517d-9b68-4773-a191-f4432a908a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:15.336714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9517d-9b68-4773-a191-f4432a908a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:15.337213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9517d-9b68-4773-a191-f4432a908a19 admin admin] PATH_INFO: `/v3/projects/f9aa537dfbf947b199b8fb3846cf0c37/users/cc4a46c0aea04e08b8e613479f1a2158/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:15.341362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9517d-9b68-4773-a191-f4432a908a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9aa537dfbf947b199b8fb3846cf0c37, user_id=cc4a46c0aea04e08b8e613479f1a2158, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:15.345014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9517d-9b68-4773-a191-f4432a908a19 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:15.409080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 870/1727] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:15 2022] PUT /identity/v3/projects/f9aa537dfbf947b199b8fb3846cf0c37/users/cc4a46c0aea04e08b8e613479f1a2158/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:15.421911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd0da7-23d6-4836-bd47-51c7f2a4aa49 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:15.423607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd0da7-23d6-4836-bd47-51c7f2a4aa49 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:15.423975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd0da7-23d6-4836-bd47-51c7f2a4aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:15.534959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-95bd0da7-23d6-4836-bd47-51c7f2a4aa49 None None] MFA Rules not processed for user `cc4a46c0aea04e08b8e613479f1a2158`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:15.536195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-95bd0da7-23d6-4836-bd47-51c7f2a4aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:15.898688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 858/1728] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:15.918225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9517d-9b68-4773-a191-f4432a908a19 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:15.921169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e2a9517d-9b68-4773-a191-f4432a908a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:16.191215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9517d-9b68-4773-a191-f4432a908a19 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:16.203044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aab33-7fc4-4d8b-8b95-1f1885e628bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:16.204015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aab33-7fc4-4d8b-8b95-1f1885e628bf service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:16.204505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aab33-7fc4-4d8b-8b95-1f1885e628bf service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:16.204928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aab33-7fc4-4d8b-8b95-1f1885e628bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:16.232280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aab33-7fc4-4d8b-8b95-1f1885e628bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:16.237616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aab33-7fc4-4d8b-8b95-1f1885e628bf service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:16.273677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 871/1729] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:16.541604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd0da7-23d6-4836-bd47-51c7f2a4aa49 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:16.544005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-95bd0da7-23d6-4836-bd47-51c7f2a4aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:16.839633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:16.936111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd0da7-23d6-4836-bd47-51c7f2a4aa49 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:16.960931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:16.961882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:16.963961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:16.965459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] PATH_INFO: `/v3/projects/78b078be4a994cccafae65732a48110b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:16.967863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b078be4a994cccafae65732a48110b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:16.976592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:17.088031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b078be4a994cccafae65732a48110b', 'request_id': 'req-ca8751a1-670f-4191-bc24-a22db2c9e552'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.118273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b078be4a994cccafae65732a48110b', 'request_id': 'req-ca8751a1-670f-4191-bc24-a22db2c9e552'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.138336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b078be4a994cccafae65732a48110b', 'request_id': 'req-ca8751a1-670f-4191-bc24-a22db2c9e552'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.224246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] The token cache is being invalidate because project 78b078be4a994cccafae65732a48110b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:17.224997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.225930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ca8751a1-670f-4191-bc24-a22db2c9e552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.228018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 859/1730] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:16 2022] DELETE /identity/v3/projects/78b078be4a994cccafae65732a48110b => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:17.232558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aab33-7fc4-4d8b-8b95-1f1885e628bf service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:17.252745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aab33-7fc4-4d8b-8b95-1f1885e628bf service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:17.254954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a407404-fa2c-43e9-b625-e76a9d0f169e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:17.255447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a407404-fa2c-43e9-b625-e76a9d0f169e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:17.256151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a407404-fa2c-43e9-b625-e76a9d0f169e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:17.336458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5a407404-fa2c-43e9-b625-e76a9d0f169e None None] MFA Rules not processed for user `d9c69e18847a40379daf843e87dad68b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:17.345489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5a407404-fa2c-43e9-b625-e76a9d0f169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:17.524613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:17.525346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:17.526240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:17.526622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] PATH_INFO: `/v3/users/2be0a31e98eb4f879ecd75771531d3b1` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:17.534985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be0a31e98eb4f879ecd75771531d3b1)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:17.543540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:17.626731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 860/1731] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:17.672550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:17.710092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be0a31e98eb4f879ecd75771531d3b1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.710700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be0a31e98eb4f879ecd75771531d3b1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.712136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be0a31e98eb4f879ecd75771531d3b1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.732316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be0a31e98eb4f879ecd75771531d3b1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.750589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a407404-fa2c-43e9-b625-e76a9d0f169e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:17.752724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-da3cf888-c95a-4c96-9b9c-b64dbe74123b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be0a31e98eb4f879ecd75771531d3b1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:17.755041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5a407404-fa2c-43e9-b625-e76a9d0f169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:17.799166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a407404-fa2c-43e9-b625-e76a9d0f169e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:17.834207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 872/1732] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:17 2022] DELETE /identity/v3/users/2be0a31e98eb4f879ecd75771531d3b1 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:17.834978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:17.835916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:17.839362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:17.840030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] PATH_INFO: `/v3/users/34ce230bd802449a9bd0560a09cfdf05` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:17.844491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ce230bd802449a9bd0560a09cfdf05)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:17.849761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:18.017164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ce230bd802449a9bd0560a09cfdf05'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:18.046184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ce230bd802449a9bd0560a09cfdf05'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:18.050018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991fb5-b43f-4fb6-ae82-685a8e0cde51 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:18.050328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991fb5-b43f-4fb6-ae82-685a8e0cde51 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:18.050633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991fb5-b43f-4fb6-ae82-685a8e0cde51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:18.054430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ce230bd802449a9bd0560a09cfdf05'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:18.120995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-42991fb5-b43f-4fb6-ae82-685a8e0cde51 None None] MFA Rules not processed for user `2f4ede1576cf4669b3a3c46d30f62f73`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:18.122886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ce230bd802449a9bd0560a09cfdf05'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:18.124355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b2b9f8ba-e1ec-4ee9-81c5-f925d39eed69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ce230bd802449a9bd0560a09cfdf05'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:18.129272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-42991fb5-b43f-4fb6-ae82-685a8e0cde51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:18.138528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:18.183411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 861/1733] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:17 2022] DELETE /identity/v3/users/34ce230bd802449a9bd0560a09cfdf05 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:18.204400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec127-453a-49b8-9041-380cd389c165 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:18.208158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec127-453a-49b8-9041-380cd389c165 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:18.208381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec127-453a-49b8-9041-380cd389c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:18.261978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-7baec127-453a-49b8-9041-380cd389c165 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:18.263348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7baec127-453a-49b8-9041-380cd389c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:18.360392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 873/1734] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:18.371583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78113cc7-dcfc-4f4d-a39b-623b034c97a8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:18.371908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78113cc7-dcfc-4f4d-a39b-623b034c97a8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:18.372158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78113cc7-dcfc-4f4d-a39b-623b034c97a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:18.462721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 862/1735] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:18.566605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec127-453a-49b8-9041-380cd389c165 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:18.568379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7baec127-453a-49b8-9041-380cd389c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:18.602028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-78113cc7-dcfc-4f4d-a39b-623b034c97a8 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:18.608049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-78113cc7-dcfc-4f4d-a39b-623b034c97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:18.709952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec127-453a-49b8-9041-380cd389c165 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:18.726812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565e529-e064-40e7-8778-f37a24506383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:18.726812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565e529-e064-40e7-8778-f37a24506383 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:18.726812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565e529-e064-40e7-8778-f37a24506383 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:18.726812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565e529-e064-40e7-8778-f37a24506383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:18.748695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565e529-e064-40e7-8778-f37a24506383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:18.750166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565e529-e064-40e7-8778-f37a24506383 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:18.774423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 863/1736] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:18.829103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 874/1737] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:18.834646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ddcd6-595b-4961-b721-760dac0a7954 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:18.835160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ddcd6-595b-4961-b721-760dac0a7954 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:18.835470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ddcd6-595b-4961-b721-760dac0a7954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:18.919688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-579ddcd6-595b-4961-b721-760dac0a7954 None None] MFA Rules not processed for user `5b91971b2a994d348a4e695b261ad914`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:18.923632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-579ddcd6-595b-4961-b721-760dac0a7954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:19.035178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78113cc7-dcfc-4f4d-a39b-623b034c97a8 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:19.037023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-78113cc7-dcfc-4f4d-a39b-623b034c97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:19.102368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 864/1738] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:19.133202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:19.313717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78113cc7-dcfc-4f4d-a39b-623b034c97a8 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:19.328161 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166871d-8621-4a2c-997a-42e32362cddf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:19.328779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166871d-8621-4a2c-997a-42e32362cddf service swift] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:19.329071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166871d-8621-4a2c-997a-42e32362cddf service swift] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:19.329352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166871d-8621-4a2c-997a-42e32362cddf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:19.355459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166871d-8621-4a2c-997a-42e32362cddf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:19.357105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166871d-8621-4a2c-997a-42e32362cddf service swift] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:19.380421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 875/1739] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:46:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:46:19.872414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3534d69-90c4-49bb-9634-46f05e992484 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:19.872928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3534d69-90c4-49bb-9634-46f05e992484 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:19.873016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3534d69-90c4-49bb-9634-46f05e992484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:19.961818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f3534d69-90c4-49bb-9634-46f05e992484 None None] MFA Rules not processed for user `a066d4114d3b438cacd7437966d17c66`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:19.965043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f3534d69-90c4-49bb-9634-46f05e992484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:20.035176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:20.184957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 865/1740] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:21.064126 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166871d-8621-4a2c-997a-42e32362cddf service swift] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:21.065622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b166871d-8621-4a2c-997a-42e32362cddf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:21.111882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166871d-8621-4a2c-997a-42e32362cddf service swift] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:21.136439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:21.137283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:21.137570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:21.137853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] PATH_INFO: `/v3/projects/d2cb9762153947348143e6f442422d73` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:21.159855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2cb9762153947348143e6f442422d73)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:21.161905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:21.326238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2cb9762153947348143e6f442422d73', 'request_id': 'req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.348158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2cb9762153947348143e6f442422d73', 'request_id': 'req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.356263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3534d69-90c4-49bb-9634-46f05e992484 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:21.358211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f3534d69-90c4-49bb-9634-46f05e992484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:21.396750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3534d69-90c4-49bb-9634-46f05e992484 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:21.397861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2cb9762153947348143e6f442422d73', 'request_id': 'req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.442925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] The token cache is being invalidate because project d2cb9762153947348143e6f442422d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:21.443446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.447019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.452232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 876/1741] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:21 2022] DELETE /identity/v3/projects/d2cb9762153947348143e6f442422d73 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:21.457470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:21.459227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:21.697294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:21.702052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a14cdb-e0c4-4bc1-8b64-8c87cac56072 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:21.711104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:21.715750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:21.716213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:21.716594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] PATH_INFO: `/v3/users/cc4a46c0aea04e08b8e613479f1a2158` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:21.718839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4a46c0aea04e08b8e613479f1a2158)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:21.726621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:21.727365 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:21.727651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] PATH_INFO: `/v3/projects/c2573e4c61804e2baa581ebd209a26ab` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:21.728043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:21.729425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2573e4c61804e2baa581ebd209a26ab)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:21.733116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:21.794019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:21.879642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4a46c0aea04e08b8e613479f1a2158'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.880413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4a46c0aea04e08b8e613479f1a2158'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.881849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4a46c0aea04e08b8e613479f1a2158'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.894013 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2573e4c61804e2baa581ebd209a26ab', 'request_id': 'req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.904577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2573e4c61804e2baa581ebd209a26ab', 'request_id': 'req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.912892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2573e4c61804e2baa581ebd209a26ab', 'request_id': 'req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.923885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4a46c0aea04e08b8e613479f1a2158'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.928144 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] The token cache is being invalidate because project c2573e4c61804e2baa581ebd209a26ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:21.928451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.929112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:21.935916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 866/1742] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:21 2022] DELETE /identity/v3/projects/c2573e4c61804e2baa581ebd209a26ab => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:21.935916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:21.935916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:21.958020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-19dce7ae-cd48-41f6-a582-3ac777f077a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4a46c0aea04e08b8e613479f1a2158'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:22.034466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:22.040655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 877/1743] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:21 2022] DELETE /identity/v3/users/cc4a46c0aea04e08b8e613479f1a2158 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:22.042103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee82510-d1ed-430c-abf8-3e43e5b57947 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:22.052110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee82510-d1ed-430c-abf8-3e43e5b57947 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:22.052515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee82510-d1ed-430c-abf8-3e43e5b57947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:22.081177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043acd9-0751-401c-a4a3-5aa6f3dda2f8 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:22.147328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-7ee82510-d1ed-430c-abf8-3e43e5b57947 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:22.148615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7ee82510-d1ed-430c-abf8-3e43e5b57947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:22.250924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d1bb7-7bf8-4ca7-8261-74cbb72cdf85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:22.254106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d1bb7-7bf8-4ca7-8261-74cbb72cdf85 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:22.254106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d1bb7-7bf8-4ca7-8261-74cbb72cdf85 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:22.256903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d1bb7-7bf8-4ca7-8261-74cbb72cdf85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:22.264698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-887d1bb7-7bf8-4ca7-8261-74cbb72cdf85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:22.273794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 878/1744] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:22.284388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98f227-dfde-45d0-bf77-64131921354b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:22.284388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98f227-dfde-45d0-bf77-64131921354b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:22.284554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98f227-dfde-45d0-bf77-64131921354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:22.351055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-3d98f227-dfde-45d0-bf77-64131921354b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:22.353055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3d98f227-dfde-45d0-bf77-64131921354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:22.364602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 879/1745] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:22.383103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98f227-dfde-45d0-bf77-64131921354b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:22.417025 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98f227-dfde-45d0-bf77-64131921354b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:22.434700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d288b-aaca-4715-a180-baf2e6ed69ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:22.437618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d288b-aaca-4715-a180-baf2e6ed69ab admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:22.437936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d288b-aaca-4715-a180-baf2e6ed69ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:22.440251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d288b-aaca-4715-a180-baf2e6ed69ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:22.442859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d288b-aaca-4715-a180-baf2e6ed69ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:22.443790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d288b-aaca-4715-a180-baf2e6ed69ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:22.447118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d288b-aaca-4715-a180-baf2e6ed69ab admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:22.455711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d1bb7-7bf8-4ca7-8261-74cbb72cdf85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:22.465574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d1bb7-7bf8-4ca7-8261-74cbb72cdf85 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:22.508127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 880/1746] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:22.513772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 867/1747] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:22.524744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d288b-aaca-4715-a180-baf2e6ed69ab admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:22.576343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d288b-aaca-4715-a180-baf2e6ed69ab admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:22.592076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5e398-c43c-47b5-9d03-fdb1e51ab113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:22.592717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5e398-c43c-47b5-9d03-fdb1e51ab113 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:22.596674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5e398-c43c-47b5-9d03-fdb1e51ab113 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:22.597697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5e398-c43c-47b5-9d03-fdb1e51ab113 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:22.598682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5e398-c43c-47b5-9d03-fdb1e51ab113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:22.601822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5e398-c43c-47b5-9d03-fdb1e51ab113 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:22.668867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 881/1748] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:22 2022] POST /identity/v3/projects => generated 359 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:22.672412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d1bb7-7bf8-4ca7-8261-74cbb72cdf85 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:22.707591 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d1bb7-7bf8-4ca7-8261-74cbb72cdf85 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:22.825298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5e398-c43c-47b5-9d03-fdb1e51ab113 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:22.828903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dbb5e398-c43c-47b5-9d03-fdb1e51ab113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:23.100468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d2f4-297a-40b4-80c6-c0e0082fd26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:23.101818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d2f4-297a-40b4-80c6-c0e0082fd26c admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:23.105600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d2f4-297a-40b4-80c6-c0e0082fd26c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:23.107019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d2f4-297a-40b4-80c6-c0e0082fd26c admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:23.108633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4d2f4-297a-40b4-80c6-c0e0082fd26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:23.115984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4d2f4-297a-40b4-80c6-c0e0082fd26c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:23.131690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:23.206027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 868/1749] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:22 2022] POST /identity/v3/users => generated 280 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:23.209694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d2f4-297a-40b4-80c6-c0e0082fd26c admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:23.216619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5e398-c43c-47b5-9d03-fdb1e51ab113 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:23.246035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ab266-5365-4db6-bb90-6fbabea811c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:23.250230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d2f4-297a-40b4-80c6-c0e0082fd26c admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:23.250490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ab266-5365-4db6-bb90-6fbabea811c3 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:23.251388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ab266-5365-4db6-bb90-6fbabea811c3 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:23.252107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ab266-5365-4db6-bb90-6fbabea811c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:23.266139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-823ab266-5365-4db6-bb90-6fbabea811c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:23.274240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd4748-dde1-4533-b76e-f4a524068ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:23.276365 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd4748-dde1-4533-b76e-f4a524068ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:23.279745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd4748-dde1-4533-b76e-f4a524068ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:23.282091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd4748-dde1-4533-b76e-f4a524068ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:23.285845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd4748-dde1-4533-b76e-f4a524068ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:23.293504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd4748-dde1-4533-b76e-f4a524068ec6 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:23.315183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:23.327526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 869/1750] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:23.334442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd4748-dde1-4533-b76e-f4a524068ec6 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:23.370422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd4748-dde1-4533-b76e-f4a524068ec6 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:23.384156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d689c8-6249-41df-8b3b-47543ff829a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:23.386369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d689c8-6249-41df-8b3b-47543ff829a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:23.387283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d689c8-6249-41df-8b3b-47543ff829a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:23.387791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d689c8-6249-41df-8b3b-47543ff829a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:23.389807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d689c8-6249-41df-8b3b-47543ff829a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:23.394146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d689c8-6249-41df-8b3b-47543ff829a9 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:23.470032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 870/1751] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:23.477599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d689c8-6249-41df-8b3b-47543ff829a9 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:23.535169 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d689c8-6249-41df-8b3b-47543ff829a9 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:23.541841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dbd50-6c9c-4c88-9ab6-5a8bd5026688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:23.543131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dbd50-6c9c-4c88-9ab6-5a8bd5026688 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:23.543665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dbd50-6c9c-4c88-9ab6-5a8bd5026688 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:23.544155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dbd50-6c9c-4c88-9ab6-5a8bd5026688 admin admin] PATH_INFO: `/v3/projects/b3fe72a136a64f46a64f338696dfbf14/users/b4e228500dc44856957cdc54e9a03e06/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:23.548857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ab266-5365-4db6-bb90-6fbabea811c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:23.550527 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ab266-5365-4db6-bb90-6fbabea811c3 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:23.567998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dbd50-6c9c-4c88-9ab6-5a8bd5026688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3fe72a136a64f46a64f338696dfbf14, user_id=b4e228500dc44856957cdc54e9a03e06, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:23.577541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dbd50-6c9c-4c88-9ab6-5a8bd5026688 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:23.627128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 882/1752] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:23.634285 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 871/1753] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:23 2022] PUT /identity/v3/projects/b3fe72a136a64f46a64f338696dfbf14/users/b4e228500dc44856957cdc54e9a03e06/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:23.645992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aa976-b8b0-452b-aa07-2bd1833c1c35 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:23.646330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aa976-b8b0-452b-aa07-2bd1833c1c35 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:23.646537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aa976-b8b0-452b-aa07-2bd1833c1c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:23.756646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-5c9aa976-b8b0-452b-aa07-2bd1833c1c35 None None] MFA Rules not processed for user `b4e228500dc44856957cdc54e9a03e06`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:23.763916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5c9aa976-b8b0-452b-aa07-2bd1833c1c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:23.994516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 883/1754] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:24.046635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dbd50-6c9c-4c88-9ab6-5a8bd5026688 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:24.050068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a96dbd50-6c9c-4c88-9ab6-5a8bd5026688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:24.273298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d0825-5d2f-47da-ba75-8398e06af664 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:24.274143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d0825-5d2f-47da-ba75-8398e06af664 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:24.274967 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d0825-5d2f-47da-ba75-8398e06af664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:24.276554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dbd50-6c9c-4c88-9ab6-5a8bd5026688 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:24.295786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cff7d-c241-436e-8d91-ef2ddedeadd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:24.296439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cff7d-c241-436e-8d91-ef2ddedeadd5 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:24.296724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cff7d-c241-436e-8d91-ef2ddedeadd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:24.297179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cff7d-c241-436e-8d91-ef2ddedeadd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:24.339159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cff7d-c241-436e-8d91-ef2ddedeadd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:24.354143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cff7d-c241-436e-8d91-ef2ddedeadd5 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:24.390635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-487d0825-5d2f-47da-ba75-8398e06af664 None None] MFA Rules not processed for user `9b072d5669e34ad5b7b52a4a6e26700b`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:24.396171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-487d0825-5d2f-47da-ba75-8398e06af664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:24.434668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 872/1755] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:24.465975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cff7d-c241-436e-8d91-ef2ddedeadd5 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:24.670577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 884/1756] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 24 11:46:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:24.761766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cff7d-c241-436e-8d91-ef2ddedeadd5 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:24.772981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:24.774787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:24.775162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:24.776266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] PATH_INFO: `/v3/users/b4e228500dc44856957cdc54e9a03e06` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:24.779011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e228500dc44856957cdc54e9a03e06)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:24.809683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:24.813051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d0825-5d2f-47da-ba75-8398e06af664 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:24.814796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-487d0825-5d2f-47da-ba75-8398e06af664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:24.864697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d0825-5d2f-47da-ba75-8398e06af664 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:24.893487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7a38a-c7a3-4a9b-9ad9-95fe190b704f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:24.899315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7a38a-c7a3-4a9b-9ad9-95fe190b704f service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:24.899595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7a38a-c7a3-4a9b-9ad9-95fe190b704f service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:24.903026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7a38a-c7a3-4a9b-9ad9-95fe190b704f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:24.945411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7a38a-c7a3-4a9b-9ad9-95fe190b704f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:24.948297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7a38a-c7a3-4a9b-9ad9-95fe190b704f service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:24.997941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 885/1757] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:25.003836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7a38a-c7a3-4a9b-9ad9-95fe190b704f service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:25.045350 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7a38a-c7a3-4a9b-9ad9-95fe190b704f service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:25.059501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e228500dc44856957cdc54e9a03e06'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:25.081495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e228500dc44856957cdc54e9a03e06'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:25.082283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e228500dc44856957cdc54e9a03e06'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:25.083081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aca092-9f4d-4bd2-95f5-604cfdd498ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:25.091041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aca092-9f4d-4bd2-95f5-604cfdd498ee service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:25.092505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aca092-9f4d-4bd2-95f5-604cfdd498ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:25.092798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aca092-9f4d-4bd2-95f5-604cfdd498ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:25.128875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:25.134499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e228500dc44856957cdc54e9a03e06'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:25.135723 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f1f98aec-d7e2-4218-b42f-66477b540cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e228500dc44856957cdc54e9a03e06'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:25.140353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aca092-9f4d-4bd2-95f5-604cfdd498ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:25.143983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aca092-9f4d-4bd2-95f5-604cfdd498ee service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:25.169109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 873/1758] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:24 2022] DELETE /identity/v3/users/b4e228500dc44856957cdc54e9a03e06 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:25.177326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef7f2-6aeb-4c12-93bf-9c7e621026a9 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:25.177812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef7f2-6aeb-4c12-93bf-9c7e621026a9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:25.179609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef7f2-6aeb-4c12-93bf-9c7e621026a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:25.180510 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 886/1759] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:25.263464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-01fef7f2-6aeb-4c12-93bf-9c7e621026a9 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:25.272684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-01fef7f2-6aeb-4c12-93bf-9c7e621026a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:25.496506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 874/1760] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:25.559250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aca092-9f4d-4bd2-95f5-604cfdd498ee service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:25.561544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a3aca092-9f4d-4bd2-95f5-604cfdd498ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:25.612089 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aca092-9f4d-4bd2-95f5-604cfdd498ee service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:25.644936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:25.967358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77c859-7448-431e-93b3-f36738697f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:25.970575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef7f2-6aeb-4c12-93bf-9c7e621026a9 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:25.972310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-01fef7f2-6aeb-4c12-93bf-9c7e621026a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:25.982045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77c859-7448-431e-93b3-f36738697f76 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:25.982396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77c859-7448-431e-93b3-f36738697f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:25.982678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77c859-7448-431e-93b3-f36738697f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:26.011724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef7f2-6aeb-4c12-93bf-9c7e621026a9 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:26.021045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77c859-7448-431e-93b3-f36738697f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:26.029991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77c859-7448-431e-93b3-f36738697f76 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:26.031570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:26.034761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:26.037828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:26.038244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] PATH_INFO: `/v3/projects/f9aa537dfbf947b199b8fb3846cf0c37` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:26.042416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9aa537dfbf947b199b8fb3846cf0c37)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:26.046042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:26.086749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 887/1761] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:26.218091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9aa537dfbf947b199b8fb3846cf0c37', 'request_id': 'req-68023b15-ef5f-48be-9afb-a422f7aecd19'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:26.231729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9aa537dfbf947b199b8fb3846cf0c37', 'request_id': 'req-68023b15-ef5f-48be-9afb-a422f7aecd19'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:26.242062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9aa537dfbf947b199b8fb3846cf0c37', 'request_id': 'req-68023b15-ef5f-48be-9afb-a422f7aecd19'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:26.274415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] The token cache is being invalidate because project f9aa537dfbf947b199b8fb3846cf0c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:26.274953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:26.277469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-68023b15-ef5f-48be-9afb-a422f7aecd19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:26.282844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 875/1762] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:25 2022] DELETE /identity/v3/projects/f9aa537dfbf947b199b8fb3846cf0c37 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:26.285586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefb904-ecda-4c3d-b34a-fc77c1f5d8ca None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:26.285965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefb904-ecda-4c3d-b34a-fc77c1f5d8ca None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:26.286335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefb904-ecda-4c3d-b34a-fc77c1f5d8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:26.327801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ccefb904-ecda-4c3d-b34a-fc77c1f5d8ca None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:26.346128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ccefb904-ecda-4c3d-b34a-fc77c1f5d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:26.577796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 888/1763] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:26.586812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b054c1-ad6b-4e9a-8696-f09c3b333a07 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:26.587000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b054c1-ad6b-4e9a-8696-f09c3b333a07 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:26.587276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b054c1-ad6b-4e9a-8696-f09c3b333a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:26.629084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d2b054c1-ad6b-4e9a-8696-f09c3b333a07 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:26.635493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d2b054c1-ad6b-4e9a-8696-f09c3b333a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:26.664976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 876/1764] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:26.670296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefb904-ecda-4c3d-b34a-fc77c1f5d8ca None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:26.685566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefb904-ecda-4c3d-b34a-fc77c1f5d8ca None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:26.712955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543615e8-093a-4dff-9325-9cee765ae442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:26.714215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543615e8-093a-4dff-9325-9cee765ae442 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:26.714215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543615e8-093a-4dff-9325-9cee765ae442 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:26.714215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543615e8-093a-4dff-9325-9cee765ae442 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:26.714822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543615e8-093a-4dff-9325-9cee765ae442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:26.715132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543615e8-093a-4dff-9325-9cee765ae442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:26.725145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543615e8-093a-4dff-9325-9cee765ae442 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:26.772879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 889/1765] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:26.777868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b054c1-ad6b-4e9a-8696-f09c3b333a07 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:26.787731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b054c1-ad6b-4e9a-8696-f09c3b333a07 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:26.809017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e59a2-552f-4fc4-af83-c51570b4d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:26.811130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e59a2-552f-4fc4-af83-c51570b4d22f admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:26.811413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e59a2-552f-4fc4-af83-c51570b4d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:26.811686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e59a2-552f-4fc4-af83-c51570b4d22f admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:26.816894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e59a2-552f-4fc4-af83-c51570b4d22f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:26.826748 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e59a2-552f-4fc4-af83-c51570b4d22f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:26.900207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 877/1766] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:26 2022] POST /identity/v3/projects => generated 355 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:26.902255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543615e8-093a-4dff-9325-9cee765ae442 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:26.922934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543615e8-093a-4dff-9325-9cee765ae442 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:27.074263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d78365-cab2-4bfc-a837-254af8abff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:27.075850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d78365-cab2-4bfc-a837-254af8abff15 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:27.075850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d78365-cab2-4bfc-a837-254af8abff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:27.076114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d78365-cab2-4bfc-a837-254af8abff15 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:27.076741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d78365-cab2-4bfc-a837-254af8abff15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:27.079410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d78365-cab2-4bfc-a837-254af8abff15 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:27.139343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 890/1767] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:26 2022] POST /identity/v3/users => generated 278 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:27.142121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e59a2-552f-4fc4-af83-c51570b4d22f admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:27.162067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e59a2-552f-4fc4-af83-c51570b4d22f admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:27.171976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23687848-2866-42a6-87a4-40c287f0d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:27.172628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23687848-2866-42a6-87a4-40c287f0d2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:27.172913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23687848-2866-42a6-87a4-40c287f0d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:27.173250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23687848-2866-42a6-87a4-40c287f0d2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:27.174611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23687848-2866-42a6-87a4-40c287f0d2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:27.177523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23687848-2866-42a6-87a4-40c287f0d2b7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:27.202267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 878/1768] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:27.203111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d78365-cab2-4bfc-a837-254af8abff15 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:27.215261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d78365-cab2-4bfc-a837-254af8abff15 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:27.234086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f86374-9417-41ae-a3f2-528e54ea494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:27.234724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86374-9417-41ae-a3f2-528e54ea494e admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:27.235029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86374-9417-41ae-a3f2-528e54ea494e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:27.235304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f86374-9417-41ae-a3f2-528e54ea494e admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:27.239760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f86374-9417-41ae-a3f2-528e54ea494e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:27.241433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f86374-9417-41ae-a3f2-528e54ea494e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:27.272121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 891/1769] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:27.286810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23687848-2866-42a6-87a4-40c287f0d2b7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:27.305089 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23687848-2866-42a6-87a4-40c287f0d2b7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:27.319915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568e66a-590b-43d8-9bf7-87cf48cc304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:27.321870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568e66a-590b-43d8-9bf7-87cf48cc304d admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:27.322320 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568e66a-590b-43d8-9bf7-87cf48cc304d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:27.322654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568e66a-590b-43d8-9bf7-87cf48cc304d admin admin] PATH_INFO: `/v3/projects/d9974e649d2b41c890fb0b07617b026f/users/6b5709776d5642a5b1a7b34cfb0bd681/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:27.373999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568e66a-590b-43d8-9bf7-87cf48cc304d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9974e649d2b41c890fb0b07617b026f, user_id=6b5709776d5642a5b1a7b34cfb0bd681, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:27.383799 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568e66a-590b-43d8-9bf7-87cf48cc304d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:27.429821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 879/1770] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:27 2022] PUT /identity/v3/projects/d9974e649d2b41c890fb0b07617b026f/users/6b5709776d5642a5b1a7b34cfb0bd681/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:27.445385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5cb7c-68af-4b28-983b-524b158f97d7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:27.445771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5cb7c-68af-4b28-983b-524b158f97d7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:27.447903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5cb7c-68af-4b28-983b-524b158f97d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:27.533409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-97a5cb7c-68af-4b28-983b-524b158f97d7 None None] MFA Rules not processed for user `6b5709776d5642a5b1a7b34cfb0bd681`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:27.535612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-97a5cb7c-68af-4b28-983b-524b158f97d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:27.546809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:27.830809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 892/1771] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:27.833392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568e66a-590b-43d8-9bf7-87cf48cc304d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:27.851503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:28.001151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568e66a-590b-43d8-9bf7-87cf48cc304d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:28.019670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c84bb-e612-4edc-a389-9318e6ccc95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:28.020364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c84bb-e612-4edc-a389-9318e6ccc95c admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:28.020648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c84bb-e612-4edc-a389-9318e6ccc95c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:28.020919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c84bb-e612-4edc-a389-9318e6ccc95c admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:28.021578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c84bb-e612-4edc-a389-9318e6ccc95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:28.023554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c84bb-e612-4edc-a389-9318e6ccc95c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:28.090503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 880/1772] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:27 2022] POST /identity/v3/projects => generated 357 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:46:28.092477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5cb7c-68af-4b28-983b-524b158f97d7 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:28.116539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5cb7c-68af-4b28-983b-524b158f97d7 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:28.326519 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2236364-9a04-4085-8763-7202238310d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:28.335371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2236364-9a04-4085-8763-7202238310d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:28.335588 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2236364-9a04-4085-8763-7202238310d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:28.335934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2236364-9a04-4085-8763-7202238310d0 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:28.336463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2236364-9a04-4085-8763-7202238310d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:28.339330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2236364-9a04-4085-8763-7202238310d0 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:28.424428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 893/1773] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:28 2022] POST /identity/v3/users => generated 285 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:28.428477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c84bb-e612-4edc-a389-9318e6ccc95c admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:28.455400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c84bb-e612-4edc-a389-9318e6ccc95c admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:28.470877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578cadf-8521-4c1f-9837-6950f903585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:28.471946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578cadf-8521-4c1f-9837-6950f903585c admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:28.473507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578cadf-8521-4c1f-9837-6950f903585c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:28.474360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578cadf-8521-4c1f-9837-6950f903585c admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:28.476449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578cadf-8521-4c1f-9837-6950f903585c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:28.483555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578cadf-8521-4c1f-9837-6950f903585c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:28.522528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2236364-9a04-4085-8763-7202238310d0 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:28.531026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 881/1774] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:28.539634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2236364-9a04-4085-8763-7202238310d0 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:28.553806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4a284-c879-4a49-8b36-f6e15dce18aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:28.554500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a284-c879-4a49-8b36-f6e15dce18aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:28.555889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a284-c879-4a49-8b36-f6e15dce18aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:28.558077 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a284-c879-4a49-8b36-f6e15dce18aa admin admin] PATH_INFO: `/v3/projects/10f5c451a35948799894224aef725af7/users/0dea2bfdcaeb4b7c980aaa57db7e65b8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:28.574881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578cadf-8521-4c1f-9837-6950f903585c admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:28.577640 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3578cadf-8521-4c1f-9837-6950f903585c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:28.618256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578cadf-8521-4c1f-9837-6950f903585c admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:28.640517 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:28.641212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:28.643293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4a284-c879-4a49-8b36-f6e15dce18aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f5c451a35948799894224aef725af7, user_id=0dea2bfdcaeb4b7c980aaa57db7e65b8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:28.643698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:28.644006 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] PATH_INFO: `/v3/projects/b3fe72a136a64f46a64f338696dfbf14` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:28.652198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3fe72a136a64f46a64f338696dfbf14)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:28.653935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:28.655314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4a284-c879-4a49-8b36-f6e15dce18aa admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:28.686529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 894/1775] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:28 2022] PUT /identity/v3/projects/10f5c451a35948799894224aef725af7/users/0dea2bfdcaeb4b7c980aaa57db7e65b8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:28.692492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4a284-c879-4a49-8b36-f6e15dce18aa admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:28.801394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3fe72a136a64f46a64f338696dfbf14', 'request_id': 'req-23c9c483-1a92-4e97-9ae2-7854f9a7a317'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:28.826663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3fe72a136a64f46a64f338696dfbf14', 'request_id': 'req-23c9c483-1a92-4e97-9ae2-7854f9a7a317'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:28.847895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3fe72a136a64f46a64f338696dfbf14', 'request_id': 'req-23c9c483-1a92-4e97-9ae2-7854f9a7a317'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:28.896886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] The token cache is being invalidate because project b3fe72a136a64f46a64f338696dfbf14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:28.897238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:28.899868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-23c9c483-1a92-4e97-9ae2-7854f9a7a317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:28.909125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 882/1776] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:28 2022] DELETE /identity/v3/projects/b3fe72a136a64f46a64f338696dfbf14 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:28.911536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4a284-c879-4a49-8b36-f6e15dce18aa admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:28.913869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e35c9-512d-4608-b6ab-6466ce41e22e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:28.914212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e35c9-512d-4608-b6ab-6466ce41e22e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:28.914490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e35c9-512d-4608-b6ab-6466ce41e22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:28.971949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:29.001249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ec8e35c9-512d-4608-b6ab-6466ce41e22e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:29.002514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ec8e35c9-512d-4608-b6ab-6466ce41e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:29.133950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944dacc-c605-4df2-8aff-fbdeae56bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:29.134719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944dacc-c605-4df2-8aff-fbdeae56bbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:29.135158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944dacc-c605-4df2-8aff-fbdeae56bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:29.135580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944dacc-c605-4df2-8aff-fbdeae56bbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:29.136320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944dacc-c605-4df2-8aff-fbdeae56bbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:29.143160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944dacc-c605-4df2-8aff-fbdeae56bbc7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:29.175109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 895/1777] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:29.179734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944dacc-c605-4df2-8aff-fbdeae56bbc7 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:29.184521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7944dacc-c605-4df2-8aff-fbdeae56bbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:29.213643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944dacc-c605-4df2-8aff-fbdeae56bbc7 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:29.227211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42dc01-1702-4339-8bbf-6449c23a8065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:29.229116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42dc01-1702-4339-8bbf-6449c23a8065 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:29.230468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42dc01-1702-4339-8bbf-6449c23a8065 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:29.230787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42dc01-1702-4339-8bbf-6449c23a8065 admin admin] PATH_INFO: `/v3/projects/10f5c451a35948799894224aef725af7/users/0dea2bfdcaeb4b7c980aaa57db7e65b8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:29.243046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42dc01-1702-4339-8bbf-6449c23a8065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f5c451a35948799894224aef725af7, user_id=0dea2bfdcaeb4b7c980aaa57db7e65b8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:29.243264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 883/1778] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:29.245817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ab2fc-0c4a-41e8-a160-1caeed02c5c0 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:29.246159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ab2fc-0c4a-41e8-a160-1caeed02c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:29.246675 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ab2fc-0c4a-41e8-a160-1caeed02c5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:29.247739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42dc01-1702-4339-8bbf-6449c23a8065 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:29.282671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:29.292638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 896/1779] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:29 2022] PUT /identity/v3/projects/10f5c451a35948799894224aef725af7/users/0dea2bfdcaeb4b7c980aaa57db7e65b8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:29.307838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666f491-65e5-4ecf-a741-81c79abc5f95 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:29.308392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666f491-65e5-4ecf-a741-81c79abc5f95 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:29.308771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666f491-65e5-4ecf-a741-81c79abc5f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:29.343570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-661ab2fc-0c4a-41e8-a160-1caeed02c5c0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:29.345703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-661ab2fc-0c4a-41e8-a160-1caeed02c5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:29.403760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6666f491-65e5-4ecf-a741-81c79abc5f95 None None] MFA Rules not processed for user `0dea2bfdcaeb4b7c980aaa57db7e65b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:29.414078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6666f491-65e5-4ecf-a741-81c79abc5f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:29.566122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 884/1780] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:29.569736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ab2fc-0c4a-41e8-a160-1caeed02c5c0 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:29.610230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-661ab2fc-0c4a-41e8-a160-1caeed02c5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:29.628251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 897/1781] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:29.629277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666f491-65e5-4ecf-a741-81c79abc5f95 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:29.699946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ab2fc-0c4a-41e8-a160-1caeed02c5c0 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:29.705410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666f491-65e5-4ecf-a741-81c79abc5f95 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:29.735317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:29.735969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:29.736332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:29.736815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:29.737296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:29.747524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:29.753764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:29.754287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:29.754989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:29.756975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] PATH_INFO: `/v3/users/6144036cc3c241fe8b352302641add23` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:29.767655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6144036cc3c241fe8b352302641add23)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:29.769875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:29.788853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:29.872585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 898/1782] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:29.874806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:29.891274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:30.074846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6144036cc3c241fe8b352302641add23'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:30.094612 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6144036cc3c241fe8b352302641add23'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:30.096920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6144036cc3c241fe8b352302641add23'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:30.130632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6144036cc3c241fe8b352302641add23'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:30.133870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6144036cc3c241fe8b352302641add23'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:30.154958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4773231-36f0-48f5-85f6-d6e2e2e145ba admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:30.170192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 885/1783] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:29 2022] DELETE /identity/v3/users/6144036cc3c241fe8b352302641add23 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:30.173838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:30.174405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a1190-083d-43ba-b938-7129bec09664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:30.175848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a1190-083d-43ba-b938-7129bec09664 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:30.176534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a1190-083d-43ba-b938-7129bec09664 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:30.177604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:30.178097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a1190-083d-43ba-b938-7129bec09664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:30.184892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-680a1190-083d-43ba-b938-7129bec09664 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:30.227888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a1190-083d-43ba-b938-7129bec09664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:30.232292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a1190-083d-43ba-b938-7129bec09664 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:30.275085 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 899/1784] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:30.279661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbba8b-62ab-43fd-bba8-551e7b041d54 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:30.279950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbba8b-62ab-43fd-bba8-551e7b041d54 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:30.280227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbba8b-62ab-43fd-bba8-551e7b041d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:30.336609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b6fbba8b-62ab-43fd-bba8-551e7b041d54 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:30.343476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b6fbba8b-62ab-43fd-bba8-551e7b041d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:30.381451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:30.419335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449973-81c5-4307-967c-fe9095d191a5 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:30.439694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252267e-51bb-453f-a39c-b8b863629cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:30.441711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252267e-51bb-453f-a39c-b8b863629cef admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:30.442864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252267e-51bb-453f-a39c-b8b863629cef admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:30.445062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252267e-51bb-453f-a39c-b8b863629cef admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:30.447418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252267e-51bb-453f-a39c-b8b863629cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:30.452474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252267e-51bb-453f-a39c-b8b863629cef admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:30.540971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 886/1785] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:30 2022] POST /identity/v3/projects => generated 373 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:30.540971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252267e-51bb-453f-a39c-b8b863629cef admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:30.546187 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 900/1786] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:30.547446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbba8b-62ab-43fd-bba8-551e7b041d54 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:30.551892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-0252267e-51bb-453f-a39c-b8b863629cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:30.565068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:30.579352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbba8b-62ab-43fd-bba8-551e7b041d54 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:30.723943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f92eda-115e-4156-a431-b4dcdb128186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:30.725100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92eda-115e-4156-a431-b4dcdb128186 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:30.725100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92eda-115e-4156-a431-b4dcdb128186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:30.725820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92eda-115e-4156-a431-b4dcdb128186 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:30.726529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f92eda-115e-4156-a431-b4dcdb128186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:30.736828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f92eda-115e-4156-a431-b4dcdb128186 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:30.780260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252267e-51bb-453f-a39c-b8b863629cef admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:30.787940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 901/1787] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:30 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:30.788896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f92eda-115e-4156-a431-b4dcdb128186 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:30.792143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-37f92eda-115e-4156-a431-b4dcdb128186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:30.806144 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa2b4d-caad-4a61-87f2-efb8f9dfd8e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:30.809784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa2b4d-caad-4a61-87f2-efb8f9dfd8e3 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:30.810097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa2b4d-caad-4a61-87f2-efb8f9dfd8e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:30.812431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa2b4d-caad-4a61-87f2-efb8f9dfd8e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:30.820246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f5aa2b4d-caad-4a61-87f2-efb8f9dfd8e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:30.906650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f92eda-115e-4156-a431-b4dcdb128186 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:30.912036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6b5b-adae-4225-b07f-18c232f1f8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:30.913559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6b5b-adae-4225-b07f-18c232f1f8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:30.914132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6b5b-adae-4225-b07f-18c232f1f8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:30.914748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6b5b-adae-4225-b07f-18c232f1f8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:30.933290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6b5b-adae-4225-b07f-18c232f1f8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:30.936753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6b5b-adae-4225-b07f-18c232f1f8c6 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:30.988417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 902/1788] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:30.989219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6b5b-adae-4225-b07f-18c232f1f8c6 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:30.999159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa2b4d-caad-4a61-87f2-efb8f9dfd8e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:31.002048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa2b4d-caad-4a61-87f2-efb8f9dfd8e3 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:31.028562 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 887/1789] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:31.094723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6b5b-adae-4225-b07f-18c232f1f8c6 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:31.116978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77509b04-7248-4041-921c-534eb3625ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:31.118016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509b04-7248-4041-921c-534eb3625ddb admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:31.118718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509b04-7248-4041-921c-534eb3625ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:31.119343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509b04-7248-4041-921c-534eb3625ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:31.120277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77509b04-7248-4041-921c-534eb3625ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:31.123179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77509b04-7248-4041-921c-534eb3625ddb admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:31.162838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 903/1790] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:31.166743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa2b4d-caad-4a61-87f2-efb8f9dfd8e3 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:31.184163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81b92-01f7-47d7-a07e-bc0c54668965 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:31.184570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81b92-01f7-47d7-a07e-bc0c54668965 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:31.185449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81b92-01f7-47d7-a07e-bc0c54668965 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:31.187224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa2b4d-caad-4a61-87f2-efb8f9dfd8e3 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:31.189326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 904/1791] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:46:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:46:31.202135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631e63c-7a48-4e75-8145-657421bfda63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:31.203985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e63c-7a48-4e75-8145-657421bfda63 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:31.206425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e63c-7a48-4e75-8145-657421bfda63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:31.207702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e63c-7a48-4e75-8145-657421bfda63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:31.214829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631e63c-7a48-4e75-8145-657421bfda63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:31.220640 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631e63c-7a48-4e75-8145-657421bfda63 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:31.253945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 888/1792] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:31.261580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81b92-01f7-47d7-a07e-bc0c54668965 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:31.313851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81b92-01f7-47d7-a07e-bc0c54668965 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:31.321447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1baf9-2e52-4803-a577-5affc586f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:31.322801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1baf9-2e52-4803-a577-5affc586f2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:31.323078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1baf9-2e52-4803-a577-5affc586f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:31.323391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1baf9-2e52-4803-a577-5affc586f2fc admin admin] PATH_INFO: `/v3/projects/b6d2a3586d254abe8fcc9d801c1630b6/users/72481f96e889488da2e7c4b6dac519d9/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:31.376540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1baf9-2e52-4803-a577-5affc586f2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d2a3586d254abe8fcc9d801c1630b6, user_id=72481f96e889488da2e7c4b6dac519d9, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:31.379948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1baf9-2e52-4803-a577-5affc586f2fc admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:31.446449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 905/1793] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:31 2022] PUT /identity/v3/projects/b6d2a3586d254abe8fcc9d801c1630b6/users/72481f96e889488da2e7c4b6dac519d9/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:31.459201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb3ee-07cc-482b-bfe2-0f66348899a4 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:31.459855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb3ee-07cc-482b-bfe2-0f66348899a4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:31.460242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb3ee-07cc-482b-bfe2-0f66348899a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:31.532232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c9fe-699b-4c80-8178-f0055c31c3e2 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:31.532785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c9fe-699b-4c80-8178-f0055c31c3e2 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:31.533144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3c9fe-699b-4c80-8178-f0055c31c3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:31.554402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4eddb3ee-07cc-482b-bfe2-0f66348899a4 None None] MFA Rules not processed for user `72481f96e889488da2e7c4b6dac519d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:31.558702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4eddb3ee-07cc-482b-bfe2-0f66348899a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:31.641885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-23d3c9fe-699b-4c80-8178-f0055c31c3e2 None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:31.646281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-23d3c9fe-699b-4c80-8178-f0055c31c3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:31.680639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:31.785757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 889/1794] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:31.817853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb3ee-07cc-482b-bfe2-0f66348899a4 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:31.852506 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 906/1795] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:46:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:32.000669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:32.066193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb3ee-07cc-482b-bfe2-0f66348899a4 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:32.080938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c6e6f-844c-4b25-b462-170f003992aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:32.081840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c6e6f-844c-4b25-b462-170f003992aa service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:32.098041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c6e6f-844c-4b25-b462-170f003992aa service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:32.098394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c6e6f-844c-4b25-b462-170f003992aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:32.159746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c6e6f-844c-4b25-b462-170f003992aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:32.163859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c6e6f-844c-4b25-b462-170f003992aa service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:32.211901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 890/1796] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:33.187582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3c9fe-699b-4c80-8178-f0055c31c3e2 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:33.189428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-23d3c9fe-699b-4c80-8178-f0055c31c3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:33.237196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3c9fe-699b-4c80-8178-f0055c31c3e2 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:33.267925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0313fbf-b319-49c7-8ef8-5098d1dbee7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:33.270743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0313fbf-b319-49c7-8ef8-5098d1dbee7d service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:33.270743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0313fbf-b319-49c7-8ef8-5098d1dbee7d service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:33.270743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0313fbf-b319-49c7-8ef8-5098d1dbee7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:33.320100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0313fbf-b319-49c7-8ef8-5098d1dbee7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:33.321775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0313fbf-b319-49c7-8ef8-5098d1dbee7d service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:33.395247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 907/1797] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:33.823328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee1961-7e03-44da-b9ec-9465ca82c3a3 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:33.824031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee1961-7e03-44da-b9ec-9465ca82c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:33.824031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee1961-7e03-44da-b9ec-9465ca82c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:33.857132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-2eee1961-7e03-44da-b9ec-9465ca82c3a3 None None] MFA Rules not processed for user `a066d4114d3b438cacd7437966d17c66`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:33.858931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2eee1961-7e03-44da-b9ec-9465ca82c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:34.017652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 891/1798] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:35.612230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0313fbf-b319-49c7-8ef8-5098d1dbee7d service nova] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:35.615325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d0313fbf-b319-49c7-8ef8-5098d1dbee7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:35.732242 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0313fbf-b319-49c7-8ef8-5098d1dbee7d service nova] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:35.742983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:35.745839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:35.746281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:35.746631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] PATH_INFO: `/v3/projects/9c68221c4dc142adb832c8606df6e557` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:35.748348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c68221c4dc142adb832c8606df6e557)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:35.762640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:35.906934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f09df-ee52-49b7-ad1f-88d2c3fdc83f None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:35.907506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f09df-ee52-49b7-ad1f-88d2c3fdc83f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:35.907506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f09df-ee52-49b7-ad1f-88d2c3fdc83f None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:35.909091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 892/1799] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:46:35.922480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c68221c4dc142adb832c8606df6e557', 'request_id': 'req-c377266a-5df4-4275-919b-b29d36547ca6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:35.932665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec484f-7305-472a-bf50-179c1edd0973 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:35.932954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec484f-7305-472a-bf50-179c1edd0973 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:35.933235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec484f-7305-472a-bf50-179c1edd0973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:35.939980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c68221c4dc142adb832c8606df6e557', 'request_id': 'req-c377266a-5df4-4275-919b-b29d36547ca6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:35.952966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c68221c4dc142adb832c8606df6e557', 'request_id': 'req-c377266a-5df4-4275-919b-b29d36547ca6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:35.989270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-0bec484f-7305-472a-bf50-179c1edd0973 None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:35.995210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] The token cache is being invalidate because project 9c68221c4dc142adb832c8606df6e557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:35.995532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-0bec484f-7305-472a-bf50-179c1edd0973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:35.995652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:35.998254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c377266a-5df4-4275-919b-b29d36547ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:36.004036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 908/1800] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:35 2022] DELETE /identity/v3/projects/9c68221c4dc142adb832c8606df6e557 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:36.010117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb2359-60b2-44ec-bf36-549b98cb6e75 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:36.012756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb2359-60b2-44ec-bf36-549b98cb6e75 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:36.013142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb2359-60b2-44ec-bf36-549b98cb6e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:36.097893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-22eb2359-60b2-44ec-bf36-549b98cb6e75 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:36.101809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-22eb2359-60b2-44ec-bf36-549b98cb6e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:36.145324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:36.245246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 909/1801] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:36.253260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b809c-5418-4e28-9ae1-f476f07fad2c None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:36.253566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b809c-5418-4e28-9ae1-f476f07fad2c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:36.253814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b809c-5418-4e28-9ae1-f476f07fad2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:36.280626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 893/1802] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:46:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 11:46:36.309868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-bc8b809c-5418-4e28-9ae1-f476f07fad2c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:36.311202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-bc8b809c-5418-4e28-9ae1-f476f07fad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:36.342803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 910/1803] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:36.345407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec484f-7305-472a-bf50-179c1edd0973 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:36.380543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec484f-7305-472a-bf50-179c1edd0973 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:36.398582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b0ade-fecf-433d-8c19-77faae32e8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:36.399427 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b0ade-fecf-433d-8c19-77faae32e8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:36.399783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b0ade-fecf-433d-8c19-77faae32e8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:36.400672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b0ade-fecf-433d-8c19-77faae32e8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:36.402220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b0ade-fecf-433d-8c19-77faae32e8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:36.405266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b0ade-fecf-433d-8c19-77faae32e8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:36.407274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b0ade-fecf-433d-8c19-77faae32e8e3 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:36.453675 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 894/1804] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:36.457536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b809c-5418-4e28-9ae1-f476f07fad2c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:36.473830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b809c-5418-4e28-9ae1-f476f07fad2c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:36.486012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e839f-0618-494f-a2e8-2a521e261505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:36.486590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e839f-0618-494f-a2e8-2a521e261505 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:36.486898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e839f-0618-494f-a2e8-2a521e261505 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:36.487170 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e839f-0618-494f-a2e8-2a521e261505 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:36.487821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e839f-0618-494f-a2e8-2a521e261505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:36.494392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e839f-0618-494f-a2e8-2a521e261505 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:36.572535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 911/1805] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:36 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:36.576805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b0ade-fecf-433d-8c19-77faae32e8e3 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:36.596431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b0ade-fecf-433d-8c19-77faae32e8e3 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:36.690629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0c3d-3225-48ac-be32-6a5bccd1c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:36.691479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0c3d-3225-48ac-be32-6a5bccd1c7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:36.692351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0c3d-3225-48ac-be32-6a5bccd1c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:36.692651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0c3d-3225-48ac-be32-6a5bccd1c7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:36.693306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0c3d-3225-48ac-be32-6a5bccd1c7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:36.695374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0c3d-3225-48ac-be32-6a5bccd1c7e2 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:36.706312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:36.727532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 895/1806] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:36 2022] POST /identity/v3/users => generated 282 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:46:36.731615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e839f-0618-494f-a2e8-2a521e261505 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:36.745443 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e839f-0618-494f-a2e8-2a521e261505 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:36.751571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f0dbc-0500-40cd-a2f5-bc4fb0ca7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:36.752273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f0dbc-0500-40cd-a2f5-bc4fb0ca7133 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:36.753010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f0dbc-0500-40cd-a2f5-bc4fb0ca7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:36.753460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f0dbc-0500-40cd-a2f5-bc4fb0ca7133 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:36.754284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f0dbc-0500-40cd-a2f5-bc4fb0ca7133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:36.757528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f0dbc-0500-40cd-a2f5-bc4fb0ca7133 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:36.772410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 912/1807] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:36.776406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0c3d-3225-48ac-be32-6a5bccd1c7e2 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:36.793783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0c3d-3225-48ac-be32-6a5bccd1c7e2 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:36.803429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c21b40-6f3c-43d0-bd5e-a2a641d9a2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:36.804189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c21b40-6f3c-43d0-bd5e-a2a641d9a2dd admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:36.804476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c21b40-6f3c-43d0-bd5e-a2a641d9a2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:36.804753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c21b40-6f3c-43d0-bd5e-a2a641d9a2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:36.805507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c21b40-6f3c-43d0-bd5e-a2a641d9a2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:36.807982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c21b40-6f3c-43d0-bd5e-a2a641d9a2dd admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:36.843707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f0dbc-0500-40cd-a2f5-bc4fb0ca7133 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:36.843938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 896/1808] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:36.844027 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f0dbc-0500-40cd-a2f5-bc4fb0ca7133 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:36.848626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e05b-1622-407e-ac97-3763719df319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:36.849708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e05b-1622-407e-ac97-3763719df319 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:36.850814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e05b-1622-407e-ac97-3763719df319 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:36.851229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e05b-1622-407e-ac97-3763719df319 admin admin] PATH_INFO: `/v3/projects/accb94ef70624f6086080ec1fa437c59/users/289e5abc7fb445679ba5053476abb57b/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:36.878045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3e05b-1622-407e-ac97-3763719df319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accb94ef70624f6086080ec1fa437c59, user_id=289e5abc7fb445679ba5053476abb57b, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:36.881044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3e05b-1622-407e-ac97-3763719df319 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:36.924289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 913/1809] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:36 2022] PUT /identity/v3/projects/accb94ef70624f6086080ec1fa437c59/users/289e5abc7fb445679ba5053476abb57b/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:36.939942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271dc1-48c0-4bf0-9653-951d40f58f68 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:36.940452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271dc1-48c0-4bf0-9653-951d40f58f68 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:36.940581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271dc1-48c0-4bf0-9653-951d40f58f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:36.949756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e05b-1622-407e-ac97-3763719df319 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:36.951697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-56e3e05b-1622-407e-ac97-3763719df319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:36.997126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-44271dc1-48c0-4bf0-9653-951d40f58f68 None None] MFA Rules not processed for user `289e5abc7fb445679ba5053476abb57b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:36.998920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-44271dc1-48c0-4bf0-9653-951d40f58f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:37.064090 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e05b-1622-407e-ac97-3763719df319 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:37.069252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:37.069899 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.070345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.070622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] PATH_INFO: `/v3/users/72481f96e889488da2e7c4b6dac519d9` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.073663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72481f96e889488da2e7c4b6dac519d9)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:37.076549 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:37.137707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 897/1810] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:37.140488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7cf6b-8bb6-42d9-98e4-b9fecbe848c0 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.146503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7cf6b-8bb6-42d9-98e4-b9fecbe848c0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.147124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7cf6b-8bb6-42d9-98e4-b9fecbe848c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.155545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72481f96e889488da2e7c4b6dac519d9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:37.156457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72481f96e889488da2e7c4b6dac519d9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:37.157099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72481f96e889488da2e7c4b6dac519d9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:37.170089 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72481f96e889488da2e7c4b6dac519d9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:37.184962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:37.186755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72481f96e889488da2e7c4b6dac519d9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:37.190376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-09e7cf6b-8bb6-42d9-98e4-b9fecbe848c0 None None] MFA Rules not processed for user `5b91971b2a994d348a4e695b261ad914`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:37.191961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-09e7cf6b-8bb6-42d9-98e4-b9fecbe848c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:37.232168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 914/1811] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:36 2022] DELETE /identity/v3/users/72481f96e889488da2e7c4b6dac519d9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:37.233205 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:37.238571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:37.282069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 898/1812] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:37.287353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfde476-93bc-4273-b1dd-ac56738fc6a9 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.287353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfde476-93bc-4273-b1dd-ac56738fc6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.287353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfde476-93bc-4273-b1dd-ac56738fc6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.312907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-cdfde476-93bc-4273-b1dd-ac56738fc6a9 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:37.314216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cdfde476-93bc-4273-b1dd-ac56738fc6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:37.343966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4bca0-4ce1-4e75-9945-8c2003538f4b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:37.352263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4ee89-6dc1-4f27-bc9f-9692e9ce6ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:37.353034 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4ee89-6dc1-4f27-bc9f-9692e9ce6ded admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.353315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4ee89-6dc1-4f27-bc9f-9692e9ce6ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.354031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4ee89-6dc1-4f27-bc9f-9692e9ce6ded admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.354874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4ee89-6dc1-4f27-bc9f-9692e9ce6ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:37.357701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4ee89-6dc1-4f27-bc9f-9692e9ce6ded admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:37.387557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 899/1813] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:37.397625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfde476-93bc-4273-b1dd-ac56738fc6a9 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:37.398113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 915/1814] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:37 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:37.400317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cdfde476-93bc-4273-b1dd-ac56738fc6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:37.402980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4ee89-6dc1-4f27-bc9f-9692e9ce6ded admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:37.426813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:37.509105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfde476-93bc-4273-b1dd-ac56738fc6a9 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:37.537880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4ee89-6dc1-4f27-bc9f-9692e9ce6ded admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:37.550178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea08f3-8f92-4eed-ae73-78ad689050e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:37.551068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea08f3-8f92-4eed-ae73-78ad689050e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.551354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea08f3-8f92-4eed-ae73-78ad689050e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.551633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea08f3-8f92-4eed-ae73-78ad689050e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.552326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea08f3-8f92-4eed-ae73-78ad689050e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:37.554281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea08f3-8f92-4eed-ae73-78ad689050e1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:37.595169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 916/1815] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:37 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:37.596594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea08f3-8f92-4eed-ae73-78ad689050e1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:37.598531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b5ea08f3-8f92-4eed-ae73-78ad689050e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:37.600081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa47005-8fc1-466a-8f6a-32f9057c6aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:37.600718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa47005-8fc1-466a-8f6a-32f9057c6aac service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.600997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa47005-8fc1-466a-8f6a-32f9057c6aac service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.601415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa47005-8fc1-466a-8f6a-32f9057c6aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.614906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa47005-8fc1-466a-8f6a-32f9057c6aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:37.616595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa47005-8fc1-466a-8f6a-32f9057c6aac service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:37.629224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 900/1816] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:37.642920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa47005-8fc1-466a-8f6a-32f9057c6aac service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:37.664253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa47005-8fc1-466a-8f6a-32f9057c6aac service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:37.676112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb0218-8bda-48a3-b6b4-424e91512742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:37.676736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb0218-8bda-48a3-b6b4-424e91512742 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.677018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb0218-8bda-48a3-b6b4-424e91512742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.677291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb0218-8bda-48a3-b6b4-424e91512742 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.677939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb0218-8bda-48a3-b6b4-424e91512742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:37.680385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb0218-8bda-48a3-b6b4-424e91512742 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:37.693784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 901/1817] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:37.698519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb0218-8bda-48a3-b6b4-424e91512742 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:37.702504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:37.724084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb0218-8bda-48a3-b6b4-424e91512742 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:37.738095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ac44-b27e-407a-9903-6d9cbf0361cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:37.740082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ac44-b27e-407a-9903-6d9cbf0361cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.741496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea08f3-8f92-4eed-ae73-78ad689050e1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:37.742049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ac44-b27e-407a-9903-6d9cbf0361cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.742362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ac44-b27e-407a-9903-6d9cbf0361cf admin admin] PATH_INFO: `/v3/projects/5e0074ef1e074317b62bec69f882449c/users/8d5842f2313c458189f59c2a52412ed7/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.749506 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c10cd7-ca0f-4e5a-9dc4-c4e6b265b4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:37.750159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c10cd7-ca0f-4e5a-9dc4-c4e6b265b4b6 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.751425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c10cd7-ca0f-4e5a-9dc4-c4e6b265b4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.751981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c10cd7-ca0f-4e5a-9dc4-c4e6b265b4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.754490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-73c10cd7-ca0f-4e5a-9dc4-c4e6b265b4b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:37.770438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c10cd7-ca0f-4e5a-9dc4-c4e6b265b4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:37.772470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c10cd7-ca0f-4e5a-9dc4-c4e6b265b4b6 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:37.779117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71ac44-b27e-407a-9903-6d9cbf0361cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0074ef1e074317b62bec69f882449c, user_id=8d5842f2313c458189f59c2a52412ed7, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:37.781872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71ac44-b27e-407a-9903-6d9cbf0361cf admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:37.786879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 917/1818] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:37.818314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 902/1819] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:37 2022] PUT /identity/v3/projects/5e0074ef1e074317b62bec69f882449c/users/8d5842f2313c458189f59c2a52412ed7/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:37.823081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c10cd7-ca0f-4e5a-9dc4-c4e6b265b4b6 service nova] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:37.839700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c10cd7-ca0f-4e5a-9dc4-c4e6b265b4b6 service nova] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:37.959374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf5207-476f-4937-aa73-150fc9704601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:37.960262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf5207-476f-4937-aa73-150fc9704601 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:37.960679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf5207-476f-4937-aa73-150fc9704601 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:37.961102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf5207-476f-4937-aa73-150fc9704601 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:37.962091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf5207-476f-4937-aa73-150fc9704601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:37.965225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf5207-476f-4937-aa73-150fc9704601 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:37.981849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 918/1820] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:37.983336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ac44-b27e-407a-9903-6d9cbf0361cf admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:37.995820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ac44-b27e-407a-9903-6d9cbf0361cf admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:38.015229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5d23-72dd-4a3e-b0d6-95ec592f884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:38.015978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5d23-72dd-4a3e-b0d6-95ec592f884f admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.016392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5d23-72dd-4a3e-b0d6-95ec592f884f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.016839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5d23-72dd-4a3e-b0d6-95ec592f884f admin admin] PATH_INFO: `/v3/projects/5e0074ef1e074317b62bec69f882449c/users/8d5842f2313c458189f59c2a52412ed7/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.020103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf5d23-72dd-4a3e-b0d6-95ec592f884f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0074ef1e074317b62bec69f882449c, user_id=8d5842f2313c458189f59c2a52412ed7, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:38.024204 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf5d23-72dd-4a3e-b0d6-95ec592f884f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:38.051811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 903/1821] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:37 2022] PUT /identity/v3/projects/5e0074ef1e074317b62bec69f882449c/users/8d5842f2313c458189f59c2a52412ed7/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:38.063767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a0ba-eeb6-45af-beac-217a3fe571c8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.064329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a0ba-eeb6-45af-beac-217a3fe571c8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.064613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a0ba-eeb6-45af-beac-217a3fe571c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.100568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-06c6a0ba-eeb6-45af-beac-217a3fe571c8 None None] MFA Rules not processed for user `8d5842f2313c458189f59c2a52412ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:38.101818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-06c6a0ba-eeb6-45af-beac-217a3fe571c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:38.220110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 919/1822] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:38.225218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5d23-72dd-4a3e-b0d6-95ec592f884f admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:38.228984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9bdf5d23-72dd-4a3e-b0d6-95ec592f884f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:38.266161 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6a0ba-eeb6-45af-beac-217a3fe571c8 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:38.268486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-06c6a0ba-eeb6-45af-beac-217a3fe571c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:38.379236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5d23-72dd-4a3e-b0d6-95ec592f884f admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:38.384572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36938f9f-1f14-4844-8a2e-9bb910a30d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:38.385362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36938f9f-1f14-4844-8a2e-9bb910a30d23 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.385635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36938f9f-1f14-4844-8a2e-9bb910a30d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.387236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36938f9f-1f14-4844-8a2e-9bb910a30d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.401392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36938f9f-1f14-4844-8a2e-9bb910a30d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:38.401880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6a0ba-eeb6-45af-beac-217a3fe571c8 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:38.403185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36938f9f-1f14-4844-8a2e-9bb910a30d23 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:38.416360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:38.417034 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.417310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.417588 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] PATH_INFO: `/v3/projects/b6d2a3586d254abe8fcc9d801c1630b6` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.418935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d2a3586d254abe8fcc9d801c1630b6)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:38.421189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:38.423093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 904/1823] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:38.423426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:38.503750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d2a3586d254abe8fcc9d801c1630b6', 'request_id': 'req-30b8fc2e-9b5e-403a-9efc-477e2e82982c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:38.514107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d2a3586d254abe8fcc9d801c1630b6', 'request_id': 'req-30b8fc2e-9b5e-403a-9efc-477e2e82982c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:38.516876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36938f9f-1f14-4844-8a2e-9bb910a30d23 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:38.523532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d2a3586d254abe8fcc9d801c1630b6', 'request_id': 'req-30b8fc2e-9b5e-403a-9efc-477e2e82982c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:38.531485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36938f9f-1f14-4844-8a2e-9bb910a30d23 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:38.550404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] The token cache is being invalidate because project b6d2a3586d254abe8fcc9d801c1630b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:38.551060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:38.551904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-30b8fc2e-9b5e-403a-9efc-477e2e82982c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:38.562590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 920/1824] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:38 2022] DELETE /identity/v3/projects/b6d2a3586d254abe8fcc9d801c1630b6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:38.564484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34ee7a-315b-4338-a2c7-9d5b0304c0fb None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.564650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34ee7a-315b-4338-a2c7-9d5b0304c0fb None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.564887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34ee7a-315b-4338-a2c7-9d5b0304c0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.567027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:38.593135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-1d34ee7a-315b-4338-a2c7-9d5b0304c0fb None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:38.594715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1d34ee7a-315b-4338-a2c7-9d5b0304c0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:38.601837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7206-b3e9-4a26-b51c-06e562d30d08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:38.602472 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7206-b3e9-4a26-b51c-06e562d30d08 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.602750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7206-b3e9-4a26-b51c-06e562d30d08 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.603102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a7206-b3e9-4a26-b51c-06e562d30d08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.605638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5f5a7206-b3e9-4a26-b51c-06e562d30d08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:38.667545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 921/1825] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:38.675610 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654797-aa2c-409c-a878-86f6438c1e7d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.675936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654797-aa2c-409c-a878-86f6438c1e7d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.676168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654797-aa2c-409c-a878-86f6438c1e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.688830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a7206-b3e9-4a26-b51c-06e562d30d08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:38.690862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a7206-b3e9-4a26-b51c-06e562d30d08 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:38.696560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-1f654797-aa2c-409c-a878-86f6438c1e7d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:38.698555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1f654797-aa2c-409c-a878-86f6438c1e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:38.703662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 905/1826] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:38.707629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 922/1827] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:38.711631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7206-b3e9-4a26-b51c-06e562d30d08 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:38.723218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a7206-b3e9-4a26-b51c-06e562d30d08 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:38.728483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793866eb-eec1-42e0-aaec-7e95be590459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:38.729347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793866eb-eec1-42e0-aaec-7e95be590459 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.729731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793866eb-eec1-42e0-aaec-7e95be590459 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.730102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793866eb-eec1-42e0-aaec-7e95be590459 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.730899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793866eb-eec1-42e0-aaec-7e95be590459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:38.731308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793866eb-eec1-42e0-aaec-7e95be590459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:38.733033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793866eb-eec1-42e0-aaec-7e95be590459 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:38.749979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 906/1828] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:46:38.751945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654797-aa2c-409c-a878-86f6438c1e7d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:38.762157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654797-aa2c-409c-a878-86f6438c1e7d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:38.767121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b9dff-97e5-4f76-acbe-fe255d8f7463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:38.767736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9dff-97e5-4f76-acbe-fe255d8f7463 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.768015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9dff-97e5-4f76-acbe-fe255d8f7463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.768286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9dff-97e5-4f76-acbe-fe255d8f7463 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.768912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b9dff-97e5-4f76-acbe-fe255d8f7463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:38.771288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b9dff-97e5-4f76-acbe-fe255d8f7463 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:38.821051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 923/1829] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:38 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:38.822854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793866eb-eec1-42e0-aaec-7e95be590459 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:38.842052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793866eb-eec1-42e0-aaec-7e95be590459 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:38.987622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be529a9-1bdc-437b-8134-caad16f9a318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:38.988296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be529a9-1bdc-437b-8134-caad16f9a318 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:38.988511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be529a9-1bdc-437b-8134-caad16f9a318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:38.989943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be529a9-1bdc-437b-8134-caad16f9a318 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:38.990640 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be529a9-1bdc-437b-8134-caad16f9a318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:38.993520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be529a9-1bdc-437b-8134-caad16f9a318 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:39.028334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 907/1830] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:38 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:46:39.032382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b9dff-97e5-4f76-acbe-fe255d8f7463 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:39.048257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b9dff-97e5-4f76-acbe-fe255d8f7463 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:39.065628 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1807-4c31-4487-8fba-9d3dc32bc28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:39.066690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1807-4c31-4487-8fba-9d3dc32bc28c admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:39.069737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1807-4c31-4487-8fba-9d3dc32bc28c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:39.069737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1807-4c31-4487-8fba-9d3dc32bc28c admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:39.069737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1807-4c31-4487-8fba-9d3dc32bc28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:39.070694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1807-4c31-4487-8fba-9d3dc32bc28c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:39.087669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 924/1831] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:39.089248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be529a9-1bdc-437b-8134-caad16f9a318 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:39.101843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be529a9-1bdc-437b-8134-caad16f9a318 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:39.108553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66aada-23f4-4b78-8a66-b0477655c70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:39.109175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66aada-23f4-4b78-8a66-b0477655c70c admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:39.109458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66aada-23f4-4b78-8a66-b0477655c70c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:39.109732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66aada-23f4-4b78-8a66-b0477655c70c admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:39.110461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66aada-23f4-4b78-8a66-b0477655c70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:39.112412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66aada-23f4-4b78-8a66-b0477655c70c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:39.128752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 908/1832] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:39.133371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1807-4c31-4487-8fba-9d3dc32bc28c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:39.145092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1807-4c31-4487-8fba-9d3dc32bc28c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:39.151683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6a771-1acc-40d1-bf64-7768b9ed69f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:39.151942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a771-1acc-40d1-bf64-7768b9ed69f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:39.152405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a771-1acc-40d1-bf64-7768b9ed69f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:39.152748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a771-1acc-40d1-bf64-7768b9ed69f8 admin admin] PATH_INFO: `/v3/projects/c4a84d716a334138ae84ecf011a16ce1/users/f6e5ed0fc3fe48738bf7509b6ca654bc/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:39.183942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6a771-1acc-40d1-bf64-7768b9ed69f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a84d716a334138ae84ecf011a16ce1, user_id=f6e5ed0fc3fe48738bf7509b6ca654bc, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:39.187147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6a771-1acc-40d1-bf64-7768b9ed69f8 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:39.207568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 925/1833] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:39 2022] PUT /identity/v3/projects/c4a84d716a334138ae84ecf011a16ce1/users/f6e5ed0fc3fe48738bf7509b6ca654bc/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:39.218263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69a610-a5f5-434b-b95c-7dffe9b25f4b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:39.218558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69a610-a5f5-434b-b95c-7dffe9b25f4b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:39.218867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69a610-a5f5-434b-b95c-7dffe9b25f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:39.252442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3f69a610-a5f5-434b-b95c-7dffe9b25f4b None None] MFA Rules not processed for user `f6e5ed0fc3fe48738bf7509b6ca654bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:39.253772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3f69a610-a5f5-434b-b95c-7dffe9b25f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:39.338396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:39.391589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 909/1834] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:39.400042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6a771-1acc-40d1-bf64-7768b9ed69f8 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:39.403412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-25a6a771-1acc-40d1-bf64-7768b9ed69f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:39.481357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:39.526902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6a771-1acc-40d1-bf64-7768b9ed69f8 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:39.531255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120883b-140d-4fa0-9173-71a6012199d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:39.532200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120883b-140d-4fa0-9173-71a6012199d2 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:39.532570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120883b-140d-4fa0-9173-71a6012199d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:39.533111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120883b-140d-4fa0-9173-71a6012199d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:39.547389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120883b-140d-4fa0-9173-71a6012199d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:39.548998 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120883b-140d-4fa0-9173-71a6012199d2 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:39.575580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 926/1835] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:42.030272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3b179-4b00-4c58-ae59-b35cf2942a49 None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:42.030947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3b179-4b00-4c58-ae59-b35cf2942a49 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:42.031124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3b179-4b00-4c58-ae59-b35cf2942a49 None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:42.032984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 910/1836] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:46:42.053121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972cded-59c3-446c-a72b-8e90fd9103b7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:42.054986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972cded-59c3-446c-a72b-8e90fd9103b7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:42.055472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972cded-59c3-446c-a72b-8e90fd9103b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:42.088863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-3972cded-59c3-446c-a72b-8e90fd9103b7 None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:42.090127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3972cded-59c3-446c-a72b-8e90fd9103b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:42.309294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 927/1837] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:46:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:42.902463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3b179-4b00-4c58-ae59-b35cf2942a49 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:43.070699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3b179-4b00-4c58-ae59-b35cf2942a49 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:43.083949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:43.085388 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:43.085864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:43.086384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] PATH_INFO: `/v3/users/f6e5ed0fc3fe48738bf7509b6ca654bc` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:43.089005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e5ed0fc3fe48738bf7509b6ca654bc)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:43.090301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972cded-59c3-446c-a72b-8e90fd9103b7 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:43.091763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:43.092828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3972cded-59c3-446c-a72b-8e90fd9103b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:43.117274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972cded-59c3-446c-a72b-8e90fd9103b7 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:43.127785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c110c-6c31-4531-824b-69ceb2570283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:43.129012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c110c-6c31-4531-824b-69ceb2570283 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:43.129554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c110c-6c31-4531-824b-69ceb2570283 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:43.131051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c110c-6c31-4531-824b-69ceb2570283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:43.151494 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c110c-6c31-4531-824b-69ceb2570283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:43.154173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c110c-6c31-4531-824b-69ceb2570283 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:43.170977 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 928/1838] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:43.186181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e5ed0fc3fe48738bf7509b6ca654bc'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:43.199755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e5ed0fc3fe48738bf7509b6ca654bc'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:43.200608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e5ed0fc3fe48738bf7509b6ca654bc'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:43.232671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e5ed0fc3fe48738bf7509b6ca654bc'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:43.234164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e5ed0fc3fe48738bf7509b6ca654bc'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:43.261711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 911/1839] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:42 2022] DELETE /identity/v3/users/f6e5ed0fc3fe48738bf7509b6ca654bc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:43.266730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66b78-b880-4d3b-934e-a9b592eb0944 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:43.267167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66b78-b880-4d3b-934e-a9b592eb0944 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:43.267536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66b78-b880-4d3b-934e-a9b592eb0944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:43.311182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ddf66b78-b880-4d3b-934e-a9b592eb0944 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:43.331523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ddf66b78-b880-4d3b-934e-a9b592eb0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:43.468370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 929/1840] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:43.594592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:43.598168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:43.759953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596286d0-0806-4ecc-848c-a33b94fe7178 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:43.766492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffca4b-abc9-4fda-9bc5-2a45d7361975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:43.768780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffca4b-abc9-4fda-9bc5-2a45d7361975 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:43.769502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffca4b-abc9-4fda-9bc5-2a45d7361975 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:43.770120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffca4b-abc9-4fda-9bc5-2a45d7361975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:43.790830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffca4b-abc9-4fda-9bc5-2a45d7361975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:43.794149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffca4b-abc9-4fda-9bc5-2a45d7361975 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:43.813001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:43.828002 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 912/1841] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:44.961352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66b78-b880-4d3b-934e-a9b592eb0944 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:44.963631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ddf66b78-b880-4d3b-934e-a9b592eb0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:44.986885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66b78-b880-4d3b-934e-a9b592eb0944 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:45.002391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:45.003418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.004327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.004887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] PATH_INFO: `/v3/projects/c4a84d716a334138ae84ecf011a16ce1` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.007160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a84d716a334138ae84ecf011a16ce1)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:45.010889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:45.085323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:45.090779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a84d716a334138ae84ecf011a16ce1', 'request_id': 'req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:45.099973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a84d716a334138ae84ecf011a16ce1', 'request_id': 'req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:45.111575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a84d716a334138ae84ecf011a16ce1', 'request_id': 'req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:45.131474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] The token cache is being invalidate because project c4a84d716a334138ae84ecf011a16ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:45.131962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:45.132801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0af2e12d-d6f1-4425-9b50-d1b6bbcc8de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:45.138254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 930/1842] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:44 2022] DELETE /identity/v3/projects/c4a84d716a334138ae84ecf011a16ce1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:45.140336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14818410-dd5c-4504-8050-ca672144bf57 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.140833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14818410-dd5c-4504-8050-ca672144bf57 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.140910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14818410-dd5c-4504-8050-ca672144bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.172673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-14818410-dd5c-4504-8050-ca672144bf57 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:45.175295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-14818410-dd5c-4504-8050-ca672144bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:45.269069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 913/1843] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:45.278104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a388-71fb-4a47-9f61-937ec617ad79 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.279415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a388-71fb-4a47-9f61-937ec617ad79 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.279880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a388-71fb-4a47-9f61-937ec617ad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.314181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-7373a388-71fb-4a47-9f61-937ec617ad79 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:45.316535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7373a388-71fb-4a47-9f61-937ec617ad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:45.335113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 931/1844] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:45.339826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14818410-dd5c-4504-8050-ca672144bf57 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:45.353934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14818410-dd5c-4504-8050-ca672144bf57 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:45.362180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be235a9-2c32-4b9a-9d58-46c22f1a2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:45.363042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be235a9-2c32-4b9a-9d58-46c22f1a2a30 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.363487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be235a9-2c32-4b9a-9d58-46c22f1a2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.363898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be235a9-2c32-4b9a-9d58-46c22f1a2a30 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.364565 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be235a9-2c32-4b9a-9d58-46c22f1a2a30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:45.364917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be235a9-2c32-4b9a-9d58-46c22f1a2a30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:45.367224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be235a9-2c32-4b9a-9d58-46c22f1a2a30 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:45.387671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 914/1845] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:45.391231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a388-71fb-4a47-9f61-937ec617ad79 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:45.407976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a388-71fb-4a47-9f61-937ec617ad79 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:45.417703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be55dc-49a0-41b0-8b2c-3122169988cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:45.418639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be55dc-49a0-41b0-8b2c-3122169988cc admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.419152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be55dc-49a0-41b0-8b2c-3122169988cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.419624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be55dc-49a0-41b0-8b2c-3122169988cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.433058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be55dc-49a0-41b0-8b2c-3122169988cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:45.437584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be55dc-49a0-41b0-8b2c-3122169988cc admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:45.495744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 932/1846] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:45 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:45.500026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be235a9-2c32-4b9a-9d58-46c22f1a2a30 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:45.512361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be235a9-2c32-4b9a-9d58-46c22f1a2a30 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:45.636056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55364c35-6a70-4a66-84ff-2d279e26c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:45.636941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364c35-6a70-4a66-84ff-2d279e26c412 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.637236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364c35-6a70-4a66-84ff-2d279e26c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.637515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364c35-6a70-4a66-84ff-2d279e26c412 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.638162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55364c35-6a70-4a66-84ff-2d279e26c412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:45.640643 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55364c35-6a70-4a66-84ff-2d279e26c412 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:45.688442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 915/1847] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:45 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:45.692675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be55dc-49a0-41b0-8b2c-3122169988cc admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:45.706864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be55dc-49a0-41b0-8b2c-3122169988cc admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:45.714030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5ce77-6e8c-49c0-ac46-5597bfec9035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:45.714665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5ce77-6e8c-49c0-ac46-5597bfec9035 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.714981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5ce77-6e8c-49c0-ac46-5597bfec9035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.715266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5ce77-6e8c-49c0-ac46-5597bfec9035 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.716023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5ce77-6e8c-49c0-ac46-5597bfec9035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:45.718514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5ce77-6e8c-49c0-ac46-5597bfec9035 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:45.736874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 933/1848] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:45.748153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55364c35-6a70-4a66-84ff-2d279e26c412 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:45.777449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55364c35-6a70-4a66-84ff-2d279e26c412 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:45.783650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7986b3-aa44-434f-a126-82e5b58a8431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:45.784288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7986b3-aa44-434f-a126-82e5b58a8431 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.784544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7986b3-aa44-434f-a126-82e5b58a8431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.784804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7986b3-aa44-434f-a126-82e5b58a8431 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.785594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7986b3-aa44-434f-a126-82e5b58a8431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:45.787829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7986b3-aa44-434f-a126-82e5b58a8431 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:45.801165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 916/1849] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:45.807184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5ce77-6e8c-49c0-ac46-5597bfec9035 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:45.818978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5ce77-6e8c-49c0-ac46-5597bfec9035 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:45.825968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a25b10-c5cb-45b1-8544-e91ed7ec22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:45.826818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a25b10-c5cb-45b1-8544-e91ed7ec22db admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.827170 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a25b10-c5cb-45b1-8544-e91ed7ec22db admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.827520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a25b10-c5cb-45b1-8544-e91ed7ec22db admin admin] PATH_INFO: `/v3/projects/6bc74c9ed41f4bd4bb51397046af8552/users/ae267b7f39244a1898109636e4691b19/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.849797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a25b10-c5cb-45b1-8544-e91ed7ec22db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc74c9ed41f4bd4bb51397046af8552, user_id=ae267b7f39244a1898109636e4691b19, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:45.854727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a25b10-c5cb-45b1-8544-e91ed7ec22db admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:45.902084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 934/1850] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:45 2022] PUT /identity/v3/projects/6bc74c9ed41f4bd4bb51397046af8552/users/ae267b7f39244a1898109636e4691b19/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:45.918373 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84280b53-e4a1-4717-b9bd-71da596b6d89 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:45.919750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84280b53-e4a1-4717-b9bd-71da596b6d89 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:45.920043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84280b53-e4a1-4717-b9bd-71da596b6d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:45.957955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-84280b53-e4a1-4717-b9bd-71da596b6d89 None None] MFA Rules not processed for user `ae267b7f39244a1898109636e4691b19`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:45.960266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-84280b53-e4a1-4717-b9bd-71da596b6d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:46.124105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:46.163197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 917/1851] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:46.172697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a25b10-c5cb-45b1-8544-e91ed7ec22db admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:46.174555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-81a25b10-c5cb-45b1-8544-e91ed7ec22db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:46.310218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a25b10-c5cb-45b1-8544-e91ed7ec22db admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:46.319253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f21a3-d0c5-4118-98e6-a2975d0f9fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:46.319894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f21a3-d0c5-4118-98e6-a2975d0f9fec service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:46.320173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f21a3-d0c5-4118-98e6-a2975d0f9fec service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:46.320627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f21a3-d0c5-4118-98e6-a2975d0f9fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:46.359807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f21a3-d0c5-4118-98e6-a2975d0f9fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:46.361333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f21a3-d0c5-4118-98e6-a2975d0f9fec service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:46.373923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 935/1852] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:46.872030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84280b53-e4a1-4717-b9bd-71da596b6d89 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:46.872030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-84280b53-e4a1-4717-b9bd-71da596b6d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:47.006176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84280b53-e4a1-4717-b9bd-71da596b6d89 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:47.011689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:47.018030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:47.018313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:47.018591 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] PATH_INFO: `/v3/users/289e5abc7fb445679ba5053476abb57b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:47.020185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=289e5abc7fb445679ba5053476abb57b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:47.022294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:47.115721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289e5abc7fb445679ba5053476abb57b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:47.127224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289e5abc7fb445679ba5053476abb57b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:47.128520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289e5abc7fb445679ba5053476abb57b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:47.152738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289e5abc7fb445679ba5053476abb57b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:47.154119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289e5abc7fb445679ba5053476abb57b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:47.175747 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 918/1853] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:46 2022] DELETE /identity/v3/users/289e5abc7fb445679ba5053476abb57b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:47.192302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68230d8d-d0dd-4358-9a47-bf28520fe0e5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:47.192866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68230d8d-d0dd-4358-9a47-bf28520fe0e5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:47.192866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68230d8d-d0dd-4358-9a47-bf28520fe0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:47.217745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-68230d8d-d0dd-4358-9a47-bf28520fe0e5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:47.223021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-68230d8d-d0dd-4358-9a47-bf28520fe0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:47.302884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 936/1854] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:47.315805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:47.317270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:47.436661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112e905-97e2-4026-b811-2259ef050236 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:47.441373 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292db2d-02bb-4165-9fb5-e7ff7fb6f544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:47.442133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292db2d-02bb-4165-9fb5-e7ff7fb6f544 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:47.442527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292db2d-02bb-4165-9fb5-e7ff7fb6f544 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:47.442913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292db2d-02bb-4165-9fb5-e7ff7fb6f544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:47.458029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292db2d-02bb-4165-9fb5-e7ff7fb6f544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:47.459627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292db2d-02bb-4165-9fb5-e7ff7fb6f544 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:47.486391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 919/1855] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:47.966348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b78c-3f57-4513-958d-3641dda52d0f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:47.966787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b78c-3f57-4513-958d-3641dda52d0f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:47.967290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b78c-3f57-4513-958d-3641dda52d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:47.992461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292db2d-02bb-4165-9fb5-e7ff7fb6f544 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:47.994731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e292db2d-02bb-4165-9fb5-e7ff7fb6f544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:48.014248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-8e38b78c-3f57-4513-958d-3641dda52d0f None None] MFA Rules not processed for user `ae267b7f39244a1898109636e4691b19`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:48.016754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8e38b78c-3f57-4513-958d-3641dda52d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:48.023482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:48.051594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292db2d-02bb-4165-9fb5-e7ff7fb6f544 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:48.061476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:48.062688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:48.063942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:48.065984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] PATH_INFO: `/v3/projects/accb94ef70624f6086080ec1fa437c59` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:48.068102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accb94ef70624f6086080ec1fa437c59)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:48.072428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:48.107923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 937/1856] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:48.126684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:48.209985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accb94ef70624f6086080ec1fa437c59', 'request_id': 'req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.219210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accb94ef70624f6086080ec1fa437c59', 'request_id': 'req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.226280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accb94ef70624f6086080ec1fa437c59', 'request_id': 'req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.243619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] The token cache is being invalidate because project accb94ef70624f6086080ec1fa437c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:48.244008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.244830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.249666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 920/1857] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:47 2022] DELETE /identity/v3/projects/accb94ef70624f6086080ec1fa437c59 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:48.250604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b78c-3f57-4513-958d-3641dda52d0f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:48.270576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b78c-3f57-4513-958d-3641dda52d0f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:48.361101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:48.361894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:48.363031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:48.363031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] PATH_INFO: `/v3/users/8d5842f2313c458189f59c2a52412ed7` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:48.364147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5842f2313c458189f59c2a52412ed7)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:48.366453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:48.428637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5842f2313c458189f59c2a52412ed7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.429288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5842f2313c458189f59c2a52412ed7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.429902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5842f2313c458189f59c2a52412ed7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.437516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5842f2313c458189f59c2a52412ed7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.447478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5842f2313c458189f59c2a52412ed7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:48.468121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 938/1858] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:48 2022] DELETE /identity/v3/users/8d5842f2313c458189f59c2a52412ed7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:48.948252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:48.950189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:48.981533 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07c9b3-ad2a-413e-b5ef-f6de6dfd9fd8 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:49.096767 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:49.097654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.098091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.098512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] PATH_INFO: `/v3/projects/5e0074ef1e074317b62bec69f882449c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.099972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0074ef1e074317b62bec69f882449c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:49.102507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:49.161637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:49.164430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:49.194997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa096c9f-bb94-4725-9557-beb3b5d08dfc admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:49.204779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0074ef1e074317b62bec69f882449c', 'request_id': 'req-af39301d-6daa-4091-b966-5e6ba5d2362d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.219243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0074ef1e074317b62bec69f882449c', 'request_id': 'req-af39301d-6daa-4091-b966-5e6ba5d2362d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.245530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0074ef1e074317b62bec69f882449c', 'request_id': 'req-af39301d-6daa-4091-b966-5e6ba5d2362d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.258880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] The token cache is being invalidate because project 5e0074ef1e074317b62bec69f882449c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:49.259181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.260363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:49.260830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-af39301d-6daa-4091-b966-5e6ba5d2362d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.262194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 921/1859] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:48 2022] DELETE /identity/v3/projects/5e0074ef1e074317b62bec69f882449c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:49.269681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3dd24-5811-4e82-bba4-467441760614 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.270040 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3dd24-5811-4e82-bba4-467441760614 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.270313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3dd24-5811-4e82-bba4-467441760614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.300493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d3d3dd24-5811-4e82-bba4-467441760614 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:49.300666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:49.301467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.301751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.302022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] PATH_INFO: `/v3/users/6b5709776d5642a5b1a7b34cfb0bd681` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.302906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d3d3dd24-5811-4e82-bba4-467441760614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:49.303717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5709776d5642a5b1a7b34cfb0bd681)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:49.306394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:49.314098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 922/1860] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:49.322831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede726f-2360-42e1-89d0-040038e47b7a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.323441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede726f-2360-42e1-89d0-040038e47b7a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.323915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede726f-2360-42e1-89d0-040038e47b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.349200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-bede726f-2360-42e1-89d0-040038e47b7a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:49.351425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bede726f-2360-42e1-89d0-040038e47b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:49.364343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 923/1861] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:49.371132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede726f-2360-42e1-89d0-040038e47b7a None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:49.377218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5709776d5642a5b1a7b34cfb0bd681'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.378197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5709776d5642a5b1a7b34cfb0bd681'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.379007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5709776d5642a5b1a7b34cfb0bd681'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.385687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede726f-2360-42e1-89d0-040038e47b7a None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:49.389420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5709776d5642a5b1a7b34cfb0bd681'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.393204 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:49.393826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.394094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.394615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.395296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:49.396202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:49.398327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:49.402115 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-808e2ab4-0313-4c10-bc3a-34689954a412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5709776d5642a5b1a7b34cfb0bd681'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:49.421477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 924/1862] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:49.428412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:49.430265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:49.436434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 939/1863] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:49 2022] DELETE /identity/v3/users/6b5709776d5642a5b1a7b34cfb0bd681 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:49.440869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82af8ab-3f8a-41e7-b84c-79225412949d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.441164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82af8ab-3f8a-41e7-b84c-79225412949d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.441456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82af8ab-3f8a-41e7-b84c-79225412949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.443074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:49.458861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973a05d-65e7-4353-bbca-7fc6f29b89c3 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:49.468765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b82af8ab-3f8a-41e7-b84c-79225412949d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:49.470047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b82af8ab-3f8a-41e7-b84c-79225412949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:49.529526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0cdb3-62df-4583-9f6a-242b1306a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:49.530144 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0cdb3-62df-4583-9f6a-242b1306a32c admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.530423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0cdb3-62df-4583-9f6a-242b1306a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.530694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0cdb3-62df-4583-9f6a-242b1306a32c admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.531386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0cdb3-62df-4583-9f6a-242b1306a32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:49.533322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0cdb3-62df-4583-9f6a-242b1306a32c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:49.537172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 940/1864] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:49.547512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82af8ab-3f8a-41e7-b84c-79225412949d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:49.548891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b82af8ab-3f8a-41e7-b84c-79225412949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:49.566479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 925/1865] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:49 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:49.567699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0cdb3-62df-4583-9f6a-242b1306a32c admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:49.620527 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82af8ab-3f8a-41e7-b84c-79225412949d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:49.633465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:49.689912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0cdb3-62df-4583-9f6a-242b1306a32c admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:49.707406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a29f7-866c-4b3d-89f7-ef66d7414c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:49.708054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a29f7-866c-4b3d-89f7-ef66d7414c6f admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.708353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a29f7-866c-4b3d-89f7-ef66d7414c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.708620 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a29f7-866c-4b3d-89f7-ef66d7414c6f admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.709258 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a29f7-866c-4b3d-89f7-ef66d7414c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:49.711306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a29f7-866c-4b3d-89f7-ef66d7414c6f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:49.729750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606d8cf-ec27-49d6-9ae3-1f8a35f69968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:49.730453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606d8cf-ec27-49d6-9ae3-1f8a35f69968 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.730948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606d8cf-ec27-49d6-9ae3-1f8a35f69968 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.731629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606d8cf-ec27-49d6-9ae3-1f8a35f69968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.753893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606d8cf-ec27-49d6-9ae3-1f8a35f69968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:49.755463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606d8cf-ec27-49d6-9ae3-1f8a35f69968 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:49.757286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 926/1866] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:49 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:49.762283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a29f7-866c-4b3d-89f7-ef66d7414c6f admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:49.781067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 941/1867] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:49.782407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a29f7-866c-4b3d-89f7-ef66d7414c6f admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:49.797064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ee8b6-1c4d-46cd-96d5-9e1cc1ac2b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:49.797763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ee8b6-1c4d-46cd-96d5-9e1cc1ac2b0a admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.798344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ee8b6-1c4d-46cd-96d5-9e1cc1ac2b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.798344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ee8b6-1c4d-46cd-96d5-9e1cc1ac2b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.799279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ee8b6-1c4d-46cd-96d5-9e1cc1ac2b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:49.804423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ee8b6-1c4d-46cd-96d5-9e1cc1ac2b0a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:49.834991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 927/1868] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:46:49.840022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606d8cf-ec27-49d6-9ae3-1f8a35f69968 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:49.854525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606d8cf-ec27-49d6-9ae3-1f8a35f69968 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:49.860575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f9f0f-1efc-4405-86e3-7e850f75141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:49.861309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f9f0f-1efc-4405-86e3-7e850f75141d admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.861660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f9f0f-1efc-4405-86e3-7e850f75141d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.862014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f9f0f-1efc-4405-86e3-7e850f75141d admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.862735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f9f0f-1efc-4405-86e3-7e850f75141d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:49.865177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f9f0f-1efc-4405-86e3-7e850f75141d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:49.880011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 942/1869] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:49.884821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ee8b6-1c4d-46cd-96d5-9e1cc1ac2b0a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:49.902102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ee8b6-1c4d-46cd-96d5-9e1cc1ac2b0a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:49.937067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4c13-55be-4ef7-8845-bfa928a58782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:49.943361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4c13-55be-4ef7-8845-bfa928a58782 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:49.943668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4c13-55be-4ef7-8845-bfa928a58782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:49.943945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4c13-55be-4ef7-8845-bfa928a58782 admin admin] PATH_INFO: `/v3/projects/41b5f2e0d1bd423a8655931e28ac7f10/users/da36089ea10f419c8320eed1b0ddb988/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:49.965053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4c13-55be-4ef7-8845-bfa928a58782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b5f2e0d1bd423a8655931e28ac7f10, user_id=da36089ea10f419c8320eed1b0ddb988, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:49.968804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4c13-55be-4ef7-8845-bfa928a58782 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:49.990882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 928/1870] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:49 2022] PUT /identity/v3/projects/41b5f2e0d1bd423a8655931e28ac7f10/users/da36089ea10f419c8320eed1b0ddb988/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:50.002229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795c48-d3de-4c37-a707-c7b14b0c9320 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.002752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795c48-d3de-4c37-a707-c7b14b0c9320 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.003203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795c48-d3de-4c37-a707-c7b14b0c9320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.044581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-42795c48-d3de-4c37-a707-c7b14b0c9320 None None] MFA Rules not processed for user `da36089ea10f419c8320eed1b0ddb988`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:50.047235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-42795c48-d3de-4c37-a707-c7b14b0c9320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:50.202709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 943/1871] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:50.203949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4c13-55be-4ef7-8845-bfa928a58782 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:50.295483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:50.320660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4c13-55be-4ef7-8845-bfa928a58782 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:50.332445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2bc1b-4a08-4e63-83c2-2811e2c72040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:50.333552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2bc1b-4a08-4e63-83c2-2811e2c72040 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.333910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2bc1b-4a08-4e63-83c2-2811e2c72040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.334385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2bc1b-4a08-4e63-83c2-2811e2c72040 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.335634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2bc1b-4a08-4e63-83c2-2811e2c72040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:50.338131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2bc1b-4a08-4e63-83c2-2811e2c72040 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:50.389336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 929/1872] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:50 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:50.393738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42795c48-d3de-4c37-a707-c7b14b0c9320 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:50.407864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42795c48-d3de-4c37-a707-c7b14b0c9320 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:50.487251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9595-74e8-4881-a062-77025b3ca93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:50.487892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9595-74e8-4881-a062-77025b3ca93e admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.488177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9595-74e8-4881-a062-77025b3ca93e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.488449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9595-74e8-4881-a062-77025b3ca93e admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.489086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba9595-74e8-4881-a062-77025b3ca93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:50.491087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba9595-74e8-4881-a062-77025b3ca93e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:50.521200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 944/1873] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:50 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:50.522371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2bc1b-4a08-4e63-83c2-2811e2c72040 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:50.539401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2bc1b-4a08-4e63-83c2-2811e2c72040 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:50.545743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bad297-061f-40f3-a2c4-2619e55df6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:50.546355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bad297-061f-40f3-a2c4-2619e55df6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.546642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bad297-061f-40f3-a2c4-2619e55df6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.546981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bad297-061f-40f3-a2c4-2619e55df6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.547629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bad297-061f-40f3-a2c4-2619e55df6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:50.549561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bad297-061f-40f3-a2c4-2619e55df6a7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:50.566102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 930/1874] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:46:50.566555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9595-74e8-4881-a062-77025b3ca93e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:50.569647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dcba9595-74e8-4881-a062-77025b3ca93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:50.570386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bad297-061f-40f3-a2c4-2619e55df6a7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:50.581912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bad297-061f-40f3-a2c4-2619e55df6a7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:50.586871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454edfb-7af6-450f-b747-05809c1b2272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:50.587495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454edfb-7af6-450f-b747-05809c1b2272 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.587776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454edfb-7af6-450f-b747-05809c1b2272 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.588050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454edfb-7af6-450f-b747-05809c1b2272 admin admin] PATH_INFO: `/v3/projects/eafa92a292014744b6c1d571cdfe018f/users/c6e407a2894542fca5899aea74b810d3/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.599720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9595-74e8-4881-a062-77025b3ca93e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:50.617733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:50.618965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.619345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.619518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] PATH_INFO: `/v3/projects/d9974e649d2b41c890fb0b07617b026f` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.620971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9974e649d2b41c890fb0b07617b026f)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:50.623154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:50.631847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454edfb-7af6-450f-b747-05809c1b2272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafa92a292014744b6c1d571cdfe018f, user_id=c6e407a2894542fca5899aea74b810d3, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:50.635624 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454edfb-7af6-450f-b747-05809c1b2272 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:50.647265 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:50.667400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 931/1875] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:50 2022] PUT /identity/v3/projects/eafa92a292014744b6c1d571cdfe018f/users/c6e407a2894542fca5899aea74b810d3/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:50.671872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454edfb-7af6-450f-b747-05809c1b2272 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:50.693543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9974e649d2b41c890fb0b07617b026f', 'request_id': 'req-65ee37e9-7a97-4d96-92cb-566e145ae307'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.701336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9974e649d2b41c890fb0b07617b026f', 'request_id': 'req-65ee37e9-7a97-4d96-92cb-566e145ae307'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.707079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9974e649d2b41c890fb0b07617b026f', 'request_id': 'req-65ee37e9-7a97-4d96-92cb-566e145ae307'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.721496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] The token cache is being invalidate because project d9974e649d2b41c890fb0b07617b026f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:50.721805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.722445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.723986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 945/1876] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:50 2022] DELETE /identity/v3/projects/d9974e649d2b41c890fb0b07617b026f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:50.728845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:50.730208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:50.747791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454edfb-7af6-450f-b747-05809c1b2272 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:50.797903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee37e9-7a97-4d96-92cb-566e145ae307 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:50.802642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:50.803316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.803598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.803873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] PATH_INFO: `/v3/users/0dea2bfdcaeb4b7c980aaa57db7e65b8` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.805082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dea2bfdcaeb4b7c980aaa57db7e65b8)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:50.808061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:50.810371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854d6f0-615e-4adf-8c2c-28a9055842f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:50.811016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854d6f0-615e-4adf-8c2c-28a9055842f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.811290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854d6f0-615e-4adf-8c2c-28a9055842f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.811557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854d6f0-615e-4adf-8c2c-28a9055842f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.812193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854d6f0-615e-4adf-8c2c-28a9055842f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:50.813754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854d6f0-615e-4adf-8c2c-28a9055842f7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:50.824639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 932/1877] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:46:50.829060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854d6f0-615e-4adf-8c2c-28a9055842f7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:50.830864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6854d6f0-615e-4adf-8c2c-28a9055842f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:50.845633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854d6f0-615e-4adf-8c2c-28a9055842f7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:50.850740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34639dd7-d4cf-4efa-9791-6d9bba4d89a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:50.851447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34639dd7-d4cf-4efa-9791-6d9bba4d89a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.851714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34639dd7-d4cf-4efa-9791-6d9bba4d89a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.851985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34639dd7-d4cf-4efa-9791-6d9bba4d89a9 admin admin] PATH_INFO: `/v3/projects/eafa92a292014744b6c1d571cdfe018f/users/c6e407a2894542fca5899aea74b810d3/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.854350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34639dd7-d4cf-4efa-9791-6d9bba4d89a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafa92a292014744b6c1d571cdfe018f, user_id=c6e407a2894542fca5899aea74b810d3, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:50.858727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34639dd7-d4cf-4efa-9791-6d9bba4d89a9 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:50.863091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dea2bfdcaeb4b7c980aaa57db7e65b8'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.863587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dea2bfdcaeb4b7c980aaa57db7e65b8'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.864763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dea2bfdcaeb4b7c980aaa57db7e65b8'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.874136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dea2bfdcaeb4b7c980aaa57db7e65b8'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.875334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 933/1878] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:50 2022] PUT /identity/v3/projects/eafa92a292014744b6c1d571cdfe018f/users/c6e407a2894542fca5899aea74b810d3/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:50.884384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dea2bfdcaeb4b7c980aaa57db7e65b8'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:50.889432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ccf02-a650-4686-9a5e-946a371aa161 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:50.889946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ccf02-a650-4686-9a5e-946a371aa161 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:50.890279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ccf02-a650-4686-9a5e-946a371aa161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:50.904744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 946/1879] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:50 2022] DELETE /identity/v3/users/0dea2bfdcaeb4b7c980aaa57db7e65b8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:50.920888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b90ccf02-a650-4686-9a5e-946a371aa161 None None] MFA Rules not processed for user `c6e407a2894542fca5899aea74b810d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:50.922123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b90ccf02-a650-4686-9a5e-946a371aa161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:50.939949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:51.011681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 934/1880] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:51.022825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:51.024551 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:51.067388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:51.106617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cffcfe-738a-412f-8ab6-12e52f30fcfa admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:51.110502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67b7b8-158e-42d2-b8e8-0fca7e1358ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:51.111321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b7b8-158e-42d2-b8e8-0fca7e1358ee service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:51.111612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b7b8-158e-42d2-b8e8-0fca7e1358ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:51.111891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b7b8-158e-42d2-b8e8-0fca7e1358ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:51.123374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67b7b8-158e-42d2-b8e8-0fca7e1358ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:51.124847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67b7b8-158e-42d2-b8e8-0fca7e1358ee service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:51.148722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 947/1881] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:51.289940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ccf02-a650-4686-9a5e-946a371aa161 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:51.292808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b90ccf02-a650-4686-9a5e-946a371aa161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:51.492379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ccf02-a650-4686-9a5e-946a371aa161 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:51.499139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:51.500177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:51.501070 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:51.501387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] PATH_INFO: `/v3/projects/10f5c451a35948799894224aef725af7` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:51.502826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f5c451a35948799894224aef725af7)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:51.505469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:51.566597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f5c451a35948799894224aef725af7', 'request_id': 'req-d8fea4f2-754b-49d2-a6bb-842b222ffd59'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:51.581242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f5c451a35948799894224aef725af7', 'request_id': 'req-d8fea4f2-754b-49d2-a6bb-842b222ffd59'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:51.589521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f5c451a35948799894224aef725af7', 'request_id': 'req-d8fea4f2-754b-49d2-a6bb-842b222ffd59'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:51.604402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] The token cache is being invalidate because project 10f5c451a35948799894224aef725af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:51.604702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:51.606032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d8fea4f2-754b-49d2-a6bb-842b222ffd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:51.608179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 935/1882] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:51 2022] DELETE /identity/v3/projects/10f5c451a35948799894224aef725af7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:51.614707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302eb8b-3641-461d-ae3a-f9e2ee3f705b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:51.615257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302eb8b-3641-461d-ae3a-f9e2ee3f705b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:51.615381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302eb8b-3641-461d-ae3a-f9e2ee3f705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:51.644853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a302eb8b-3641-461d-ae3a-f9e2ee3f705b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:51.646249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a302eb8b-3641-461d-ae3a-f9e2ee3f705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:51.740413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 948/1883] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:51.749088 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dbb9b-7dd0-47ba-810b-e3f420f0c161 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:51.749381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dbb9b-7dd0-47ba-810b-e3f420f0c161 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:51.749687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dbb9b-7dd0-47ba-810b-e3f420f0c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:51.779698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-cc3dbb9b-7dd0-47ba-810b-e3f420f0c161 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:51.781130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cc3dbb9b-7dd0-47ba-810b-e3f420f0c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:51.801965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 936/1884] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:51.807160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302eb8b-3641-461d-ae3a-f9e2ee3f705b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:51.824221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302eb8b-3641-461d-ae3a-f9e2ee3f705b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:51.829800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1b05f-d1e3-484b-9528-8544f467b030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:51.830417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b05f-d1e3-484b-9528-8544f467b030 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:51.830737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b05f-d1e3-484b-9528-8544f467b030 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:51.831028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b05f-d1e3-484b-9528-8544f467b030 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:51.831684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1b05f-d1e3-484b-9528-8544f467b030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:51.831994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1b05f-d1e3-484b-9528-8544f467b030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:51.833603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1b05f-d1e3-484b-9528-8544f467b030 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:51.848390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 949/1885] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:46:51.853583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dbb9b-7dd0-47ba-810b-e3f420f0c161 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:51.863420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dbb9b-7dd0-47ba-810b-e3f420f0c161 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:51.871336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651ce43-a847-4d75-bd39-eed7b083c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:51.872051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651ce43-a847-4d75-bd39-eed7b083c405 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:51.872337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651ce43-a847-4d75-bd39-eed7b083c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:51.872610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651ce43-a847-4d75-bd39-eed7b083c405 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:51.873249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651ce43-a847-4d75-bd39-eed7b083c405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:51.875224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651ce43-a847-4d75-bd39-eed7b083c405 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:51.910956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 937/1886] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:51 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:51.914147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1b05f-d1e3-484b-9528-8544f467b030 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:51.924841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1b05f-d1e3-484b-9528-8544f467b030 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:51.998993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4e366-0e6e-42d8-95dd-8ebba062587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:51.999716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4e366-0e6e-42d8-95dd-8ebba062587a admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:51.999935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4e366-0e6e-42d8-95dd-8ebba062587a admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.000219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4e366-0e6e-42d8-95dd-8ebba062587a admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.000866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4e366-0e6e-42d8-95dd-8ebba062587a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:52.002870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4e366-0e6e-42d8-95dd-8ebba062587a admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:52.030488 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 950/1887] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:51 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:46:52.035104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651ce43-a847-4d75-bd39-eed7b083c405 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.046349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651ce43-a847-4d75-bd39-eed7b083c405 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:52.051949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533951-162d-402b-b2f8-64ba81805e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:52.055411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533951-162d-402b-b2f8-64ba81805e18 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:52.056705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533951-162d-402b-b2f8-64ba81805e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.057377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533951-162d-402b-b2f8-64ba81805e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.058347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94533951-162d-402b-b2f8-64ba81805e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:52.060192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94533951-162d-402b-b2f8-64ba81805e18 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:52.067715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:52.078227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4e366-0e6e-42d8-95dd-8ebba062587a admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.084419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 938/1888] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:52.092328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4e366-0e6e-42d8-95dd-8ebba062587a admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:52.100504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78376455-6663-4c36-9402-59f852e61865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:52.101296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78376455-6663-4c36-9402-59f852e61865 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:52.101611 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78376455-6663-4c36-9402-59f852e61865 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.102100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78376455-6663-4c36-9402-59f852e61865 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.103980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78376455-6663-4c36-9402-59f852e61865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:52.105727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78376455-6663-4c36-9402-59f852e61865 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:52.129366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533951-162d-402b-b2f8-64ba81805e18 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.136577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 951/1889] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:46:52.142498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533951-162d-402b-b2f8-64ba81805e18 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:52.148537 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1211483-4ffb-48a6-981a-aa2d92035ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:52.149994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1211483-4ffb-48a6-981a-aa2d92035ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:52.150288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1211483-4ffb-48a6-981a-aa2d92035ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.150726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1211483-4ffb-48a6-981a-aa2d92035ef1 admin admin] PATH_INFO: `/v3/projects/73d8752f78ec49e18241fd15ef2bfa38/users/f4fef529cefc41f682302405ad46ac4a/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.186594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1211483-4ffb-48a6-981a-aa2d92035ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d8752f78ec49e18241fd15ef2bfa38, user_id=f4fef529cefc41f682302405ad46ac4a, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:52.189551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1211483-4ffb-48a6-981a-aa2d92035ef1 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:52.210308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 939/1890] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:52 2022] PUT /identity/v3/projects/73d8752f78ec49e18241fd15ef2bfa38/users/f4fef529cefc41f682302405ad46ac4a/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:52.220859 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8decc-a77e-48f5-9aa0-2380c6e812d4 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:52.221998 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8decc-a77e-48f5-9aa0-2380c6e812d4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.222240 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8decc-a77e-48f5-9aa0-2380c6e812d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.260091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-60e8decc-a77e-48f5-9aa0-2380c6e812d4 None None] MFA Rules not processed for user `f4fef529cefc41f682302405ad46ac4a`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:52.261547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-60e8decc-a77e-48f5-9aa0-2380c6e812d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:52.287945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:52.349123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 952/1891] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:52.353691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1211483-4ffb-48a6-981a-aa2d92035ef1 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.437436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1211483-4ffb-48a6-981a-aa2d92035ef1 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:52.445123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3268c-0ed5-43fc-84d2-9f4a2e68d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:52.445915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3268c-0ed5-43fc-84d2-9f4a2e68d96a admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:52.446436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3268c-0ed5-43fc-84d2-9f4a2e68d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.446937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3268c-0ed5-43fc-84d2-9f4a2e68d96a admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.447775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3268c-0ed5-43fc-84d2-9f4a2e68d96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:52.450462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3268c-0ed5-43fc-84d2-9f4a2e68d96a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:52.503501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 940/1892] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:52 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:52.507806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8decc-a77e-48f5-9aa0-2380c6e812d4 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.524781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8decc-a77e-48f5-9aa0-2380c6e812d4 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:52.615834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9535504-0b84-46a4-9bdb-b96df2120784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:52.616559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9535504-0b84-46a4-9bdb-b96df2120784 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:52.616741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9535504-0b84-46a4-9bdb-b96df2120784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.617266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9535504-0b84-46a4-9bdb-b96df2120784 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.619790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9535504-0b84-46a4-9bdb-b96df2120784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:52.626171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9535504-0b84-46a4-9bdb-b96df2120784 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:52.658100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 953/1893] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:52 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:52.662127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3268c-0ed5-43fc-84d2-9f4a2e68d96a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.679511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3268c-0ed5-43fc-84d2-9f4a2e68d96a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:52.690910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf163765-7db4-45c5-a38a-127b98f09129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:52.692034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf163765-7db4-45c5-a38a-127b98f09129 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:52.692773 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf163765-7db4-45c5-a38a-127b98f09129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.693133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf163765-7db4-45c5-a38a-127b98f09129 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.694001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf163765-7db4-45c5-a38a-127b98f09129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:52.695879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf163765-7db4-45c5-a38a-127b98f09129 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:52.714434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9535504-0b84-46a4-9bdb-b96df2120784 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.714744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 941/1894] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:52.726352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9535504-0b84-46a4-9bdb-b96df2120784 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:52.733124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85765d13-81f7-431c-88b3-c2da2c451543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:52.733961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85765d13-81f7-431c-88b3-c2da2c451543 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:52.734491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85765d13-81f7-431c-88b3-c2da2c451543 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.735019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85765d13-81f7-431c-88b3-c2da2c451543 admin admin] PATH_INFO: `/v3/projects/89766dab5db8475ea3c9659183d65726/users/98d5e7a939d04d2abd3a6b484eb278c6/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.756872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85765d13-81f7-431c-88b3-c2da2c451543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89766dab5db8475ea3c9659183d65726, user_id=98d5e7a939d04d2abd3a6b484eb278c6, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:52.760639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85765d13-81f7-431c-88b3-c2da2c451543 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:52.786182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 954/1895] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:52 2022] PUT /identity/v3/projects/89766dab5db8475ea3c9659183d65726/users/98d5e7a939d04d2abd3a6b484eb278c6/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:52.787381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf163765-7db4-45c5-a38a-127b98f09129 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.807067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf163765-7db4-45c5-a38a-127b98f09129 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:52.959898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e7c1-6f98-496f-b3d8-0d31d8f53d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:52.961306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e7c1-6f98-496f-b3d8-0d31d8f53d08 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:52.962404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e7c1-6f98-496f-b3d8-0d31d8f53d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:52.962956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e7c1-6f98-496f-b3d8-0d31d8f53d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:52.964304 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e7c1-6f98-496f-b3d8-0d31d8f53d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:52.966293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e7c1-6f98-496f-b3d8-0d31d8f53d08 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:52.981473 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85765d13-81f7-431c-88b3-c2da2c451543 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.983425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-85765d13-81f7-431c-88b3-c2da2c451543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:52.986010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 942/1896] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:52.993748 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e7c1-6f98-496f-b3d8-0d31d8f53d08 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:52.999481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85765d13-81f7-431c-88b3-c2da2c451543 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:53.006077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e7c1-6f98-496f-b3d8-0d31d8f53d08 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:53.006401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:53.008250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:53.009447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:53.009824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] PATH_INFO: `/v3/users/da36089ea10f419c8320eed1b0ddb988` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:53.011846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da36089ea10f419c8320eed1b0ddb988)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:53.014082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:53.017678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ef138-e37f-4959-974a-6a9552828ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:53.018655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ef138-e37f-4959-974a-6a9552828ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:53.019068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ef138-e37f-4959-974a-6a9552828ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:53.020260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ef138-e37f-4959-974a-6a9552828ebb admin admin] PATH_INFO: `/v3/projects/89766dab5db8475ea3c9659183d65726/users/98d5e7a939d04d2abd3a6b484eb278c6/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:53.024979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ef138-e37f-4959-974a-6a9552828ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=89766dab5db8475ea3c9659183d65726, user_id=98d5e7a939d04d2abd3a6b484eb278c6, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:53.029544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ef138-e37f-4959-974a-6a9552828ebb admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:53.046577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 943/1897] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:52 2022] PUT /identity/v3/projects/89766dab5db8475ea3c9659183d65726/users/98d5e7a939d04d2abd3a6b484eb278c6/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:53.058934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141ce0-8bb2-4254-b0d2-466fcc3a2a49 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:53.059299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141ce0-8bb2-4254-b0d2-466fcc3a2a49 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:53.059685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141ce0-8bb2-4254-b0d2-466fcc3a2a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:53.088735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da36089ea10f419c8320eed1b0ddb988'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:53.089434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da36089ea10f419c8320eed1b0ddb988'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:53.090105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da36089ea10f419c8320eed1b0ddb988'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:53.099607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da36089ea10f419c8320eed1b0ddb988'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:53.105116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e3141ce0-8bb2-4254-b0d2-466fcc3a2a49 None None] MFA Rules not processed for user `98d5e7a939d04d2abd3a6b484eb278c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:53.106621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e3141ce0-8bb2-4254-b0d2-466fcc3a2a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:53.111728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a995e97f-bf5a-4d54-91e5-307e2c08cd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da36089ea10f419c8320eed1b0ddb988'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:53.132374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:53.135796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:53.142457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 955/1898] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:52 2022] DELETE /identity/v3/users/da36089ea10f419c8320eed1b0ddb988 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:53.148679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab828a-f1c0-44b6-b48b-0b5da23582d5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:53.149709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab828a-f1c0-44b6-b48b-0b5da23582d5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:53.150587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab828a-f1c0-44b6-b48b-0b5da23582d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:53.182921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a0ab828a-f1c0-44b6-b48b-0b5da23582d5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:53.203033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a0ab828a-f1c0-44b6-b48b-0b5da23582d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:53.234505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 944/1899] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:53.244702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141ce0-8bb2-4254-b0d2-466fcc3a2a49 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:53.246847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e3141ce0-8bb2-4254-b0d2-466fcc3a2a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:53.259541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 956/1900] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:53.270207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab828a-f1c0-44b6-b48b-0b5da23582d5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:53.271897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a0ab828a-f1c0-44b6-b48b-0b5da23582d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:53.329394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141ce0-8bb2-4254-b0d2-466fcc3a2a49 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:53.366035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab828a-f1c0-44b6-b48b-0b5da23582d5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:53.377730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb0852-cb14-4afa-9f98-6d72c1295bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:53.379686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb0852-cb14-4afa-9f98-6d72c1295bca service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:53.380145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb0852-cb14-4afa-9f98-6d72c1295bca service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:53.380517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb0852-cb14-4afa-9f98-6d72c1295bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:53.426457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb0852-cb14-4afa-9f98-6d72c1295bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:53.427244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce5fb6-248d-4800-8495-d4d57a950f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:53.427498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce5fb6-248d-4800-8495-d4d57a950f9a service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:53.427713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce5fb6-248d-4800-8495-d4d57a950f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:53.427990 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce5fb6-248d-4800-8495-d4d57a950f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:53.428221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb0852-cb14-4afa-9f98-6d72c1295bca service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:53.430086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-11ce5fb6-248d-4800-8495-d4d57a950f9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:53.454976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 957/1901] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:46:53.572392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce5fb6-248d-4800-8495-d4d57a950f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:53.576076 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce5fb6-248d-4800-8495-d4d57a950f9a service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:53.595644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 945/1902] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:54.345478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb0852-cb14-4afa-9f98-6d72c1295bca service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:54.347300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-cfbb0852-cb14-4afa-9f98-6d72c1295bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:54.372721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb0852-cb14-4afa-9f98-6d72c1295bca service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:54.379705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:54.379959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:54.380298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:54.380641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] PATH_INFO: `/v3/projects/41b5f2e0d1bd423a8655931e28ac7f10` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:54.382255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b5f2e0d1bd423a8655931e28ac7f10)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:54.385483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:54.512416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b5f2e0d1bd423a8655931e28ac7f10', 'request_id': 'req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.525165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b5f2e0d1bd423a8655931e28ac7f10', 'request_id': 'req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.534698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b5f2e0d1bd423a8655931e28ac7f10', 'request_id': 'req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.552402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] The token cache is being invalidate because project 41b5f2e0d1bd423a8655931e28ac7f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:54.552877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.553958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.556232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 958/1903] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:54 2022] DELETE /identity/v3/projects/41b5f2e0d1bd423a8655931e28ac7f10 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:54.560248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce5fb6-248d-4800-8495-d4d57a950f9a service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:54.577647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce5fb6-248d-4800-8495-d4d57a950f9a service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:54.624571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:54.666593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:54.667286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:54.667571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:54.667849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] PATH_INFO: `/v3/users/c6e407a2894542fca5899aea74b810d3` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:54.669654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e407a2894542fca5899aea74b810d3)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:54.671924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:54.731536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e407a2894542fca5899aea74b810d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.739885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e407a2894542fca5899aea74b810d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.740707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e407a2894542fca5899aea74b810d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.766005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e407a2894542fca5899aea74b810d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.767265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e407a2894542fca5899aea74b810d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:54.791631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 946/1904] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:54 2022] DELETE /identity/v3/users/c6e407a2894542fca5899aea74b810d3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:46:55.198415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:55.199934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:55.250706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:55.308220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d28ec1-acea-44ec-8477-fc2f7bd0368a admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:55.409862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6394b4b-7bde-4728-94c5-4b8d43cdb7fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:55.412154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6394b4b-7bde-4728-94c5-4b8d43cdb7fc service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:55.412829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6394b4b-7bde-4728-94c5-4b8d43cdb7fc service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:55.413376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6394b4b-7bde-4728-94c5-4b8d43cdb7fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:55.417103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f6394b4b-7bde-4728-94c5-4b8d43cdb7fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:55.525499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:55.531322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:55.553460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6394b4b-7bde-4728-94c5-4b8d43cdb7fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:55.555414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6394b4b-7bde-4728-94c5-4b8d43cdb7fc service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:55.614984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 959/1905] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:55.710078 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bed70-dce5-420b-8004-cad390877d7d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:55.726259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:55.727086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:55.727407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:55.729735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] PATH_INFO: `/v3/projects/eafa92a292014744b6c1d571cdfe018f` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:55.731056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafa92a292014744b6c1d571cdfe018f)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:55.732983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:55.809212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafa92a292014744b6c1d571cdfe018f', 'request_id': 'req-31692084-3008-42b6-ae19-b8ba063ccf72'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:55.811761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:55.824167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafa92a292014744b6c1d571cdfe018f', 'request_id': 'req-31692084-3008-42b6-ae19-b8ba063ccf72'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:55.886416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafa92a292014744b6c1d571cdfe018f', 'request_id': 'req-31692084-3008-42b6-ae19-b8ba063ccf72'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:55.933257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] The token cache is being invalidate because project eafa92a292014744b6c1d571cdfe018f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:46:55.933558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:55.942874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-31692084-3008-42b6-ae19-b8ba063ccf72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:46:55.960439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 947/1906] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:46:55 2022] DELETE /identity/v3/projects/eafa92a292014744b6c1d571cdfe018f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:55.966577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d80d0-df85-40d7-8cc7-9d1ed5d7418d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:55.967032 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d80d0-df85-40d7-8cc7-9d1ed5d7418d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:55.967396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d80d0-df85-40d7-8cc7-9d1ed5d7418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.017799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-580d80d0-df85-40d7-8cc7-9d1ed5d7418d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:56.019953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-580d80d0-df85-40d7-8cc7-9d1ed5d7418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:56.135947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 960/1907] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:56.138700 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad3128-ea2f-476c-b787-212ac99de4dc None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:56.139825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad3128-ea2f-476c-b787-212ac99de4dc None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:56.140317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad3128-ea2f-476c-b787-212ac99de4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.182627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-59ad3128-ea2f-476c-b787-212ac99de4dc None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:56.183909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-59ad3128-ea2f-476c-b787-212ac99de4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:56.206219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 948/1908] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:56.207392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d80d0-df85-40d7-8cc7-9d1ed5d7418d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:56.221561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d80d0-df85-40d7-8cc7-9d1ed5d7418d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:56.227559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00b22e-d8a8-428d-a224-d5f18616eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:56.228535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00b22e-d8a8-428d-a224-d5f18616eac8 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:56.229139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00b22e-d8a8-428d-a224-d5f18616eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:56.229758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00b22e-d8a8-428d-a224-d5f18616eac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.231179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00b22e-d8a8-428d-a224-d5f18616eac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:46:56.231867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00b22e-d8a8-428d-a224-d5f18616eac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:56.234010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00b22e-d8a8-428d-a224-d5f18616eac8 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:56.255152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad3128-ea2f-476c-b787-212ac99de4dc None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:56.261014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 961/1909] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:46:56.267300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad3128-ea2f-476c-b787-212ac99de4dc None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:56.274200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a565-fecf-4423-b514-ff3f555f30a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:56.275512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a565-fecf-4423-b514-ff3f555f30a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:56.276532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a565-fecf-4423-b514-ff3f555f30a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:56.276930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a565-fecf-4423-b514-ff3f555f30a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.277886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950a565-fecf-4423-b514-ff3f555f30a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:56.280727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950a565-fecf-4423-b514-ff3f555f30a5 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:56.334496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 949/1910] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:56 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:56.349730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00b22e-d8a8-428d-a224-d5f18616eac8 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:56.360857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00b22e-d8a8-428d-a224-d5f18616eac8 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:56.385484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:56.471683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7314c-f7e4-4eac-8e0e-2546e6b80273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:56.472445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7314c-f7e4-4eac-8e0e-2546e6b80273 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:56.472840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7314c-f7e4-4eac-8e0e-2546e6b80273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:56.473204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7314c-f7e4-4eac-8e0e-2546e6b80273 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.473921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7314c-f7e4-4eac-8e0e-2546e6b80273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:56.476439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7314c-f7e4-4eac-8e0e-2546e6b80273 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:56.503502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 962/1911] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:56 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:56.507446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a565-fecf-4423-b514-ff3f555f30a5 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:56.522803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a565-fecf-4423-b514-ff3f555f30a5 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:56.528850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f5df-052b-4213-a74c-4f82d287ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:56.529616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f5df-052b-4213-a74c-4f82d287ce82 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:56.529971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f5df-052b-4213-a74c-4f82d287ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:56.530317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f5df-052b-4213-a74c-4f82d287ce82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.531087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577f5df-052b-4213-a74c-4f82d287ce82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:56.532789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577f5df-052b-4213-a74c-4f82d287ce82 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:56.554652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 950/1912] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:56.559733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7314c-f7e4-4eac-8e0e-2546e6b80273 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:56.574296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7314c-f7e4-4eac-8e0e-2546e6b80273 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:56.581068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c617fa-0d30-4f9a-883e-a2b40128835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:56.581487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c617fa-0d30-4f9a-883e-a2b40128835f admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:56.581780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c617fa-0d30-4f9a-883e-a2b40128835f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:56.582295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c617fa-0d30-4f9a-883e-a2b40128835f admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.583141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c617fa-0d30-4f9a-883e-a2b40128835f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:56.585277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c617fa-0d30-4f9a-883e-a2b40128835f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:56.607201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 963/1913] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:56.608453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f5df-052b-4213-a74c-4f82d287ce82 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:56.619933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f5df-052b-4213-a74c-4f82d287ce82 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:56.625098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39f99-d0be-4cc8-a122-ebcf3a14c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:56.625788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39f99-d0be-4cc8-a122-ebcf3a14c2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:56.626070 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39f99-d0be-4cc8-a122-ebcf3a14c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:56.626344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39f99-d0be-4cc8-a122-ebcf3a14c2cc admin admin] PATH_INFO: `/v3/projects/b0dbc8897f2c4366bdbb2a1119e51bd3/users/a865c90ddcd0486eb90a6634e9002424/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.652273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39f99-d0be-4cc8-a122-ebcf3a14c2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0dbc8897f2c4366bdbb2a1119e51bd3, user_id=a865c90ddcd0486eb90a6634e9002424, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:56.655313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39f99-d0be-4cc8-a122-ebcf3a14c2cc admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:56.673208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 951/1914] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:56 2022] PUT /identity/v3/projects/b0dbc8897f2c4366bdbb2a1119e51bd3/users/a865c90ddcd0486eb90a6634e9002424/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:56.686393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e45ec-a22f-400f-a029-e5ce69152c9b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:56.688624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e45ec-a22f-400f-a029-e5ce69152c9b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:56.688624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e45ec-a22f-400f-a029-e5ce69152c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.723180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b35e45ec-a22f-400f-a029-e5ce69152c9b None None] MFA Rules not processed for user `a865c90ddcd0486eb90a6634e9002424`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:56.724435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b35e45ec-a22f-400f-a029-e5ce69152c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:56.815806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 964/1915] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:56.823151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39f99-d0be-4cc8-a122-ebcf3a14c2cc admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:56.961555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39f99-d0be-4cc8-a122-ebcf3a14c2cc admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:56.967721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74843a26-e90e-401a-b2b0-736cf0152d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:56.968490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74843a26-e90e-401a-b2b0-736cf0152d1b admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:56.969063 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74843a26-e90e-401a-b2b0-736cf0152d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:56.969365 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74843a26-e90e-401a-b2b0-736cf0152d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:56.970004 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74843a26-e90e-401a-b2b0-736cf0152d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:56.972209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74843a26-e90e-401a-b2b0-736cf0152d1b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.006795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 952/1916] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:56 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:57.010694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e45ec-a22f-400f-a029-e5ce69152c9b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.027707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e45ec-a22f-400f-a029-e5ce69152c9b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.098608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11471cca-9d4d-4bd4-b114-2ba0c6a9342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.099291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471cca-9d4d-4bd4-b114-2ba0c6a9342a admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.099578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471cca-9d4d-4bd4-b114-2ba0c6a9342a admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.099858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471cca-9d4d-4bd4-b114-2ba0c6a9342a admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.100512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11471cca-9d4d-4bd4-b114-2ba0c6a9342a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.102576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11471cca-9d4d-4bd4-b114-2ba0c6a9342a admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.126643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 965/1917] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:57 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:46:57.130866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74843a26-e90e-401a-b2b0-736cf0152d1b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.144642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74843a26-e90e-401a-b2b0-736cf0152d1b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.151767 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f819e-03e2-4f72-9bc2-d3171ec4b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.152404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f819e-03e2-4f72-9bc2-d3171ec4b067 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.152691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f819e-03e2-4f72-9bc2-d3171ec4b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.153043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f819e-03e2-4f72-9bc2-d3171ec4b067 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.153793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f819e-03e2-4f72-9bc2-d3171ec4b067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.155638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f819e-03e2-4f72-9bc2-d3171ec4b067 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.173595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 953/1918] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:46:57.175154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11471cca-9d4d-4bd4-b114-2ba0c6a9342a admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.189410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11471cca-9d4d-4bd4-b114-2ba0c6a9342a admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.194838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534994f-7ff3-45f5-951c-4682f45e8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.195620 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534994f-7ff3-45f5-951c-4682f45e8366 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.196505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534994f-7ff3-45f5-951c-4682f45e8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.196793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534994f-7ff3-45f5-951c-4682f45e8366 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.197452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534994f-7ff3-45f5-951c-4682f45e8366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.199124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534994f-7ff3-45f5-951c-4682f45e8366 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.212310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 966/1919] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:57.216727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f819e-03e2-4f72-9bc2-d3171ec4b067 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.228026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f819e-03e2-4f72-9bc2-d3171ec4b067 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.232962 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f824d-43b4-42a1-a0f9-3437e687c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.233716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f824d-43b4-42a1-a0f9-3437e687c150 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.234069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f824d-43b4-42a1-a0f9-3437e687c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.234434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f824d-43b4-42a1-a0f9-3437e687c150 admin admin] PATH_INFO: `/v3/projects/ff806fb00413498c99e2bde73e710528/users/71e3f23289c24819814ad688e604d6c2/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.252970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f824d-43b4-42a1-a0f9-3437e687c150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff806fb00413498c99e2bde73e710528, user_id=71e3f23289c24819814ad688e604d6c2, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.255879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f824d-43b4-42a1-a0f9-3437e687c150 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.293659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 954/1920] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:57 2022] PUT /identity/v3/projects/ff806fb00413498c99e2bde73e710528/users/71e3f23289c24819814ad688e604d6c2/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:57.295738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d4aa-aa5d-456a-825c-42c28c5f70d3 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.296147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d4aa-aa5d-456a-825c-42c28c5f70d3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.296429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d4aa-aa5d-456a-825c-42c28c5f70d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.315467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:57.339418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-2593d4aa-aa5d-456a-825c-42c28c5f70d3 None None] MFA Rules not processed for user `71e3f23289c24819814ad688e604d6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:57.340741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-2593d4aa-aa5d-456a-825c-42c28c5f70d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:57.413662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 967/1921] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:46:57.419036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f824d-43b4-42a1-a0f9-3437e687c150 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.451021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:57.492666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f824d-43b4-42a1-a0f9-3437e687c150 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.499527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859c2bb-77c2-43b7-ba1f-3c26b543e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.500468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859c2bb-77c2-43b7-ba1f-3c26b543e0eb admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.500627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859c2bb-77c2-43b7-ba1f-3c26b543e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.501033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859c2bb-77c2-43b7-ba1f-3c26b543e0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.502053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859c2bb-77c2-43b7-ba1f-3c26b543e0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.504218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859c2bb-77c2-43b7-ba1f-3c26b543e0eb admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.546585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 955/1922] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:46:57 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:46:57.550413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593d4aa-aa5d-456a-825c-42c28c5f70d3 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.562412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593d4aa-aa5d-456a-825c-42c28c5f70d3 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.636216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5b478-1644-4f9d-b132-94a43cfe3b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.636851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5b478-1644-4f9d-b132-94a43cfe3b8c admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.637129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5b478-1644-4f9d-b132-94a43cfe3b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.637407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5b478-1644-4f9d-b132-94a43cfe3b8c admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.638051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5b478-1644-4f9d-b132-94a43cfe3b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.640228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5b478-1644-4f9d-b132-94a43cfe3b8c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.666276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 968/1923] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:46:57 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:46:57.668372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859c2bb-77c2-43b7-ba1f-3c26b543e0eb admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.682617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859c2bb-77c2-43b7-ba1f-3c26b543e0eb admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.687785 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977f78e-02f3-4ef4-bd19-819b24e1a95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.688420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f78e-02f3-4ef4-bd19-819b24e1a95d admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.688703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f78e-02f3-4ef4-bd19-819b24e1a95d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.689068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f78e-02f3-4ef4-bd19-819b24e1a95d admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.689731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977f78e-02f3-4ef4-bd19-819b24e1a95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.691495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977f78e-02f3-4ef4-bd19-819b24e1a95d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.703505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 956/1924] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:57.707723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5b478-1644-4f9d-b132-94a43cfe3b8c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.719206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5b478-1644-4f9d-b132-94a43cfe3b8c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.723957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5e33a-6cb9-4529-97a6-9f3b7c558e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.724620 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5e33a-6cb9-4529-97a6-9f3b7c558e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.724903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5e33a-6cb9-4529-97a6-9f3b7c558e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.725177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5e33a-6cb9-4529-97a6-9f3b7c558e20 admin admin] PATH_INFO: `/v3/projects/beedd1c48dbd4659b711fd0d4f3ddb99/users/21c7c26ad5bc4deda2bc29eff926b7cd/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.744197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5e33a-6cb9-4529-97a6-9f3b7c558e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beedd1c48dbd4659b711fd0d4f3ddb99, user_id=21c7c26ad5bc4deda2bc29eff926b7cd, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.747342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5e33a-6cb9-4529-97a6-9f3b7c558e20 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.763887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 969/1925] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:57 2022] PUT /identity/v3/projects/beedd1c48dbd4659b711fd0d4f3ddb99/users/21c7c26ad5bc4deda2bc29eff926b7cd/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:57.768396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977f78e-02f3-4ef4-bd19-819b24e1a95d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.781939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977f78e-02f3-4ef4-bd19-819b24e1a95d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.850694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04477d51-7202-4e5f-b5a5-19ab188c5faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.851493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04477d51-7202-4e5f-b5a5-19ab188c5faa admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.851876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04477d51-7202-4e5f-b5a5-19ab188c5faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.853045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04477d51-7202-4e5f-b5a5-19ab188c5faa admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.853673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04477d51-7202-4e5f-b5a5-19ab188c5faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.855619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04477d51-7202-4e5f-b5a5-19ab188c5faa admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.872610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 957/1926] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:46:57.878326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5e33a-6cb9-4529-97a6-9f3b7c558e20 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:57.889722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5e33a-6cb9-4529-97a6-9f3b7c558e20 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:57.895214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f8c4-56e0-42a1-883d-46733f9c2094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:57.895954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f8c4-56e0-42a1-883d-46733f9c2094 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.896295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f8c4-56e0-42a1-883d-46733f9c2094 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.896652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f8c4-56e0-42a1-883d-46733f9c2094 admin admin] PATH_INFO: `/v3/projects/beedd1c48dbd4659b711fd0d4f3ddb99/users/21c7c26ad5bc4deda2bc29eff926b7cd/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.898661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574f8c4-56e0-42a1-883d-46733f9c2094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beedd1c48dbd4659b711fd0d4f3ddb99, user_id=21c7c26ad5bc4deda2bc29eff926b7cd, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:57.901433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574f8c4-56e0-42a1-883d-46733f9c2094 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:57.923410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 970/1927] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:46:57 2022] PUT /identity/v3/projects/beedd1c48dbd4659b711fd0d4f3ddb99/users/21c7c26ad5bc4deda2bc29eff926b7cd/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:46:57.924899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183f5d-9b15-4fd7-b941-cb078e0235dd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:57.925192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183f5d-9b15-4fd7-b941-cb078e0235dd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:57.925470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183f5d-9b15-4fd7-b941-cb078e0235dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:57.958667 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-88183f5d-9b15-4fd7-b941-cb078e0235dd None None] MFA Rules not processed for user `21c7c26ad5bc4deda2bc29eff926b7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:46:57.959920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-88183f5d-9b15-4fd7-b941-cb078e0235dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:58.038211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 958/1928] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:46:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:46:58.051791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f8c4-56e0-42a1-883d-46733f9c2094 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:58.053920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b574f8c4-56e0-42a1-883d-46733f9c2094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:58.121970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:58.126555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f8c4-56e0-42a1-883d-46733f9c2094 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:58.131841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603345f2-54d7-436e-b722-f4326f97c264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:58.133760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603345f2-54d7-436e-b722-f4326f97c264 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:58.134216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603345f2-54d7-436e-b722-f4326f97c264 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:58.134644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603345f2-54d7-436e-b722-f4326f97c264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:58.148462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603345f2-54d7-436e-b722-f4326f97c264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:58.150953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603345f2-54d7-436e-b722-f4326f97c264 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:58.181275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 971/1929] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:58.991148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88183f5d-9b15-4fd7-b941-cb078e0235dd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:59.003888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88183f5d-9b15-4fd7-b941-cb078e0235dd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:59.007919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9423d6a-edc2-4113-bff8-547a0634e800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:59.008591 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9423d6a-edc2-4113-bff8-547a0634e800 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:59.008868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9423d6a-edc2-4113-bff8-547a0634e800 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:59.009144 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9423d6a-edc2-4113-bff8-547a0634e800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:59.080281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:46:59.159939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9423d6a-edc2-4113-bff8-547a0634e800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:59.161509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9423d6a-edc2-4113-bff8-547a0634e800 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:46:59.178632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 959/1930] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:46:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:46:59.815370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603345f2-54d7-436e-b722-f4326f97c264 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:46:59.817721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-603345f2-54d7-436e-b722-f4326f97c264 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:46:59.912258 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603345f2-54d7-436e-b722-f4326f97c264 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:46:59.918149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:46:59.918897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:46:59.919182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:46:59.919461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] PATH_INFO: `/v3/users/f4fef529cefc41f682302405ad46ac4a` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:46:59.920814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fef529cefc41f682302405ad46ac4a)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:46:59.922909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:00.011513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fef529cefc41f682302405ad46ac4a'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:00.012192 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fef529cefc41f682302405ad46ac4a'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:00.012814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fef529cefc41f682302405ad46ac4a'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:00.024908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fef529cefc41f682302405ad46ac4a'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:00.036460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fef529cefc41f682302405ad46ac4a'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:00.065894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 972/1931] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:46:59 2022] DELETE /identity/v3/users/f4fef529cefc41f682302405ad46ac4a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:00.070446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cce6d-4e8b-407a-b2d2-6d32ac33c267 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:00.071188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cce6d-4e8b-407a-b2d2-6d32ac33c267 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:00.071188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cce6d-4e8b-407a-b2d2-6d32ac33c267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:00.103613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ec9cce6d-4e8b-407a-b2d2-6d32ac33c267 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:00.105218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ec9cce6d-4e8b-407a-b2d2-6d32ac33c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:00.195556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 960/1932] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:00.222990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:00.224856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:00.303911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e984-4079-4077-91f9-874abaf8b3e3 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:00.311516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf099-6320-492b-807f-4b273472f730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:00.312209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf099-6320-492b-807f-4b273472f730 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:00.312484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf099-6320-492b-807f-4b273472f730 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:00.312810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf099-6320-492b-807f-4b273472f730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:00.325621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbf099-6320-492b-807f-4b273472f730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:00.327170 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbf099-6320-492b-807f-4b273472f730 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:00.339724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 973/1933] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:01.641569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cce6d-4e8b-407a-b2d2-6d32ac33c267 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:01.644761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ec9cce6d-4e8b-407a-b2d2-6d32ac33c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:01.672492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cce6d-4e8b-407a-b2d2-6d32ac33c267 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:01.707746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:01.709986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:01.713369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:01.713867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] PATH_INFO: `/v3/projects/73d8752f78ec49e18241fd15ef2bfa38` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:01.716604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d8752f78ec49e18241fd15ef2bfa38)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:01.721431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:01.809099 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d8752f78ec49e18241fd15ef2bfa38', 'request_id': 'req-b942b108-383c-40a0-8137-1b6fcd05d3e4'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:01.820130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d8752f78ec49e18241fd15ef2bfa38', 'request_id': 'req-b942b108-383c-40a0-8137-1b6fcd05d3e4'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:01.828271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d8752f78ec49e18241fd15ef2bfa38', 'request_id': 'req-b942b108-383c-40a0-8137-1b6fcd05d3e4'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:01.840503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] The token cache is being invalidate because project 73d8752f78ec49e18241fd15ef2bfa38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:01.841104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:01.841783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:01.843490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 961/1934] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:01 2022] DELETE /identity/v3/projects/73d8752f78ec49e18241fd15ef2bfa38 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:01.847659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf099-6320-492b-807f-4b273472f730 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:01.858434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf099-6320-492b-807f-4b273472f730 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:01.868497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:01.941607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:01.942517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:01.942914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:01.943285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] PATH_INFO: `/v3/users/98d5e7a939d04d2abd3a6b484eb278c6` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:01.944706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d5e7a939d04d2abd3a6b484eb278c6)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:01.947284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:02.001647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d5e7a939d04d2abd3a6b484eb278c6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.002427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d5e7a939d04d2abd3a6b484eb278c6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.003160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d5e7a939d04d2abd3a6b484eb278c6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.013722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d5e7a939d04d2abd3a6b484eb278c6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.023018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4e4ee550-fa87-41dd-b02d-66a0dc331f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d5e7a939d04d2abd3a6b484eb278c6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.043150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 974/1935] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:01 2022] DELETE /identity/v3/users/98d5e7a939d04d2abd3a6b484eb278c6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:02.437175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:02.438850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:02.465205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b108-383c-40a0-8137-1b6fcd05d3e4 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:02.570680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:02.599334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:02.600441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:02.600717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:02.600988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] PATH_INFO: `/v3/projects/89766dab5db8475ea3c9659183d65726` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:02.602323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89766dab5db8475ea3c9659183d65726)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:02.605192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:02.702496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89766dab5db8475ea3c9659183d65726', 'request_id': 'req-a296acd8-42e0-4a9b-840f-ff90392c9c71'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.713527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89766dab5db8475ea3c9659183d65726', 'request_id': 'req-a296acd8-42e0-4a9b-840f-ff90392c9c71'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.723935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89766dab5db8475ea3c9659183d65726', 'request_id': 'req-a296acd8-42e0-4a9b-840f-ff90392c9c71'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.738214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] The token cache is being invalidate because project 89766dab5db8475ea3c9659183d65726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:02.738827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.739550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a296acd8-42e0-4a9b-840f-ff90392c9c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:02.741172 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 962/1936] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:02 2022] DELETE /identity/v3/projects/89766dab5db8475ea3c9659183d65726 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:02.746965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0329dc8-1da0-4e59-a99b-dcebb226ab8c None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:02.747332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0329dc8-1da0-4e59-a99b-dcebb226ab8c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:02.747677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0329dc8-1da0-4e59-a99b-dcebb226ab8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:02.771113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d0329dc8-1da0-4e59-a99b-dcebb226ab8c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:02.772454 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d0329dc8-1da0-4e59-a99b-dcebb226ab8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:02.891604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 975/1937] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:02.900921 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ebf1-71bc-473c-82b3-f3f983dc59ea None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:02.901298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ebf1-71bc-473c-82b3-f3f983dc59ea None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:02.902598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ebf1-71bc-473c-82b3-f3f983dc59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:02.928890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-1270ebf1-71bc-473c-82b3-f3f983dc59ea None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:02.930934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1270ebf1-71bc-473c-82b3-f3f983dc59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:02.952615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 963/1938] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:02.956822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0329dc8-1da0-4e59-a99b-dcebb226ab8c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:02.969909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0329dc8-1da0-4e59-a99b-dcebb226ab8c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:02.976412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4074e5-e893-44b7-aba6-920753a45859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:02.977921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4074e5-e893-44b7-aba6-920753a45859 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:02.978823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4074e5-e893-44b7-aba6-920753a45859 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:02.978823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4074e5-e893-44b7-aba6-920753a45859 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:02.979318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4074e5-e893-44b7-aba6-920753a45859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:02.979625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4074e5-e893-44b7-aba6-920753a45859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:02.981252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4074e5-e893-44b7-aba6-920753a45859 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:02.995843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 976/1939] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:03.000739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ebf1-71bc-473c-82b3-f3f983dc59ea None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:03.011159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ebf1-71bc-473c-82b3-f3f983dc59ea None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:03.022336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9209701-460e-409e-af39-dabf6dd5e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:03.023364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9209701-460e-409e-af39-dabf6dd5e2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:03.023945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9209701-460e-409e-af39-dabf6dd5e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:03.024970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9209701-460e-409e-af39-dabf6dd5e2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:03.027375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9209701-460e-409e-af39-dabf6dd5e2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:03.031784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9209701-460e-409e-af39-dabf6dd5e2e1 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:03.081010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 964/1940] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:02 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:03.085055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4074e5-e893-44b7-aba6-920753a45859 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:03.098131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4074e5-e893-44b7-aba6-920753a45859 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:03.124571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:03.179166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdceee-6e5e-4865-b5ca-246fb7958179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:03.181160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdceee-6e5e-4865-b5ca-246fb7958179 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:03.181160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdceee-6e5e-4865-b5ca-246fb7958179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:03.181160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdceee-6e5e-4865-b5ca-246fb7958179 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:03.181596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdceee-6e5e-4865-b5ca-246fb7958179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:03.184312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdceee-6e5e-4865-b5ca-246fb7958179 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:03.211463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 977/1941] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:03 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:03.216185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9209701-460e-409e-af39-dabf6dd5e2e1 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:03.239759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9209701-460e-409e-af39-dabf6dd5e2e1 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:03.257950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c6cc1-9862-44b9-819a-cb2a6ffca6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:03.257950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c6cc1-9862-44b9-819a-cb2a6ffca6ec admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:03.257950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c6cc1-9862-44b9-819a-cb2a6ffca6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:03.257950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c6cc1-9862-44b9-819a-cb2a6ffca6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:03.261635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c6cc1-9862-44b9-819a-cb2a6ffca6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:03.261635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c6cc1-9862-44b9-819a-cb2a6ffca6ec admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:03.290424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 965/1942] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:03.291963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdceee-6e5e-4865-b5ca-246fb7958179 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:03.313429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdceee-6e5e-4865-b5ca-246fb7958179 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:03.319380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95b9f6-13b4-4e10-850e-459ebbaa77ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:03.320015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95b9f6-13b4-4e10-850e-459ebbaa77ca admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:03.320299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95b9f6-13b4-4e10-850e-459ebbaa77ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:03.320647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95b9f6-13b4-4e10-850e-459ebbaa77ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:03.321644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95b9f6-13b4-4e10-850e-459ebbaa77ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:03.324157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95b9f6-13b4-4e10-850e-459ebbaa77ca admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:03.345440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 978/1943] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:47:03.347120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c6cc1-9862-44b9-819a-cb2a6ffca6ec admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:03.361494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c6cc1-9862-44b9-819a-cb2a6ffca6ec admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:03.369092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be75b-6b7d-419b-8c30-c5a060443ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:03.369864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be75b-6b7d-419b-8c30-c5a060443ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:03.370210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be75b-6b7d-419b-8c30-c5a060443ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:03.370570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be75b-6b7d-419b-8c30-c5a060443ff8 admin admin] PATH_INFO: `/v3/projects/3dfe4d2d64ed4e8195c6c179e5719f62/users/bc64623708ae477ba4c1efbb58dcb82b/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:03.390795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be75b-6b7d-419b-8c30-c5a060443ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfe4d2d64ed4e8195c6c179e5719f62, user_id=bc64623708ae477ba4c1efbb58dcb82b, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:03.394595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be75b-6b7d-419b-8c30-c5a060443ff8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:03.447218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 966/1944] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:03 2022] PUT /identity/v3/projects/3dfe4d2d64ed4e8195c6c179e5719f62/users/bc64623708ae477ba4c1efbb58dcb82b/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:03.457739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e06f70-cc7a-4cb4-9f4c-3d768a63b7cf None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:03.458030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e06f70-cc7a-4cb4-9f4c-3d768a63b7cf None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:03.458307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e06f70-cc7a-4cb4-9f4c-3d768a63b7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:03.510029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a7e06f70-cc7a-4cb4-9f4c-3d768a63b7cf None None] MFA Rules not processed for user `bc64623708ae477ba4c1efbb58dcb82b`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:03.511409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a7e06f70-cc7a-4cb4-9f4c-3d768a63b7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:03.606955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 979/1945] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:03.610837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be75b-6b7d-419b-8c30-c5a060443ff8 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:03.706033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be75b-6b7d-419b-8c30-c5a060443ff8 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:03.713122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911449-c1e8-449a-82c1-23d9244d893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:03.714044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911449-c1e8-449a-82c1-23d9244d893f admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:03.714476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911449-c1e8-449a-82c1-23d9244d893f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:03.714977 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911449-c1e8-449a-82c1-23d9244d893f admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:03.715760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba911449-c1e8-449a-82c1-23d9244d893f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:03.717934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba911449-c1e8-449a-82c1-23d9244d893f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:03.736247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:03.754806 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 967/1946] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:03 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:03.758808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e06f70-cc7a-4cb4-9f4c-3d768a63b7cf None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:03.799083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e06f70-cc7a-4cb4-9f4c-3d768a63b7cf None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:03.895405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a54ca-bf8f-4dde-a607-6741459304e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:03.896280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a54ca-bf8f-4dde-a607-6741459304e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:03.896803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a54ca-bf8f-4dde-a607-6741459304e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:03.897178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a54ca-bf8f-4dde-a607-6741459304e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:03.897916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a54ca-bf8f-4dde-a607-6741459304e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:03.900596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a54ca-bf8f-4dde-a607-6741459304e2 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:03.964889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 980/1947] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:03 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:03.966314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911449-c1e8-449a-82c1-23d9244d893f admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:03.981130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911449-c1e8-449a-82c1-23d9244d893f admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:03.994404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede4df4-16ce-4f7f-938f-ae811e2ffb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:03.996596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4df4-16ce-4f7f-938f-ae811e2ffb2c admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:03.997350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4df4-16ce-4f7f-938f-ae811e2ffb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:03.997350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4df4-16ce-4f7f-938f-ae811e2ffb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:04.000276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4df4-16ce-4f7f-938f-ae811e2ffb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:04.002113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4df4-16ce-4f7f-938f-ae811e2ffb2c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:04.023070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a54ca-bf8f-4dde-a607-6741459304e2 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:04.025185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3e5a54ca-bf8f-4dde-a607-6741459304e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:04.033124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 968/1948] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:04.035340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede4df4-16ce-4f7f-938f-ae811e2ffb2c admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:04.057535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede4df4-16ce-4f7f-938f-ae811e2ffb2c admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:04.084419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:04.089050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bda73-79db-4330-bf67-477406de4423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:04.089394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bda73-79db-4330-bf67-477406de4423 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:04.089773 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bda73-79db-4330-bf67-477406de4423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:04.090040 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bda73-79db-4330-bf67-477406de4423 admin admin] PATH_INFO: `/v3/projects/3d4198cce2ba496bac5ba54b5d7a7aa6/users/2f1dbbf6169d4e2ea86ae4afe355ba30/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:04.120579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bda73-79db-4330-bf67-477406de4423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4198cce2ba496bac5ba54b5d7a7aa6, user_id=2f1dbbf6169d4e2ea86ae4afe355ba30, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:04.123317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bda73-79db-4330-bf67-477406de4423 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:04.150884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 969/1949] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:04 2022] PUT /identity/v3/projects/3d4198cce2ba496bac5ba54b5d7a7aa6/users/2f1dbbf6169d4e2ea86ae4afe355ba30/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:04.151072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bda73-79db-4330-bf67-477406de4423 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:04.174886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a54ca-bf8f-4dde-a607-6741459304e2 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:04.246894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e483564-46ce-49ef-bc24-b24c78f5b4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:04.247871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e483564-46ce-49ef-bc24-b24c78f5b4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:04.248387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e483564-46ce-49ef-bc24-b24c78f5b4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:04.248751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e483564-46ce-49ef-bc24-b24c78f5b4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:04.250906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3e483564-46ce-49ef-bc24-b24c78f5b4b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:04.257320 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bda73-79db-4330-bf67-477406de4423 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:04.265952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af944b92-e5b8-4fd5-bbdc-0f71b4ad8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:04.266752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af944b92-e5b8-4fd5-bbdc-0f71b4ad8499 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:04.267071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af944b92-e5b8-4fd5-bbdc-0f71b4ad8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:04.267403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af944b92-e5b8-4fd5-bbdc-0f71b4ad8499 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:04.268073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af944b92-e5b8-4fd5-bbdc-0f71b4ad8499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:04.271263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af944b92-e5b8-4fd5-bbdc-0f71b4ad8499 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:04.308498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 970/1950] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:47:04.309774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af944b92-e5b8-4fd5-bbdc-0f71b4ad8499 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:04.325303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af944b92-e5b8-4fd5-bbdc-0f71b4ad8499 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:04.339630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e915e45-77bf-4e88-aa9a-93564f157258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:04.341167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e915e45-77bf-4e88-aa9a-93564f157258 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:04.341564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e915e45-77bf-4e88-aa9a-93564f157258 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:04.342162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e915e45-77bf-4e88-aa9a-93564f157258 admin admin] PATH_INFO: `/v3/projects/3d4198cce2ba496bac5ba54b5d7a7aa6/users/2f1dbbf6169d4e2ea86ae4afe355ba30/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:04.344610 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e483564-46ce-49ef-bc24-b24c78f5b4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:04.345952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e915e45-77bf-4e88-aa9a-93564f157258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4198cce2ba496bac5ba54b5d7a7aa6, user_id=2f1dbbf6169d4e2ea86ae4afe355ba30, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:04.346343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e483564-46ce-49ef-bc24-b24c78f5b4b0 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:04.349121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e915e45-77bf-4e88-aa9a-93564f157258 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:04.358079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 981/1951] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:04.370133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 971/1952] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:04 2022] PUT /identity/v3/projects/3d4198cce2ba496bac5ba54b5d7a7aa6/users/2f1dbbf6169d4e2ea86ae4afe355ba30/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:04.380504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcfe8b-e203-4957-8ee4-e850fe89bf3c None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:04.380790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcfe8b-e203-4957-8ee4-e850fe89bf3c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:04.381069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcfe8b-e203-4957-8ee4-e850fe89bf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:04.417320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-51dcfe8b-e203-4957-8ee4-e850fe89bf3c None None] MFA Rules not processed for user `2f1dbbf6169d4e2ea86ae4afe355ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:04.419147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-51dcfe8b-e203-4957-8ee4-e850fe89bf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:04.535279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 982/1953] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:04.536346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e915e45-77bf-4e88-aa9a-93564f157258 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:04.538230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8e915e45-77bf-4e88-aa9a-93564f157258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:04.633723 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e915e45-77bf-4e88-aa9a-93564f157258 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:04.641370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7527a-488c-4b08-afd2-d262e29ddd1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:04.642364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7527a-488c-4b08-afd2-d262e29ddd1f service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:04.642708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7527a-488c-4b08-afd2-d262e29ddd1f service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:04.643041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7527a-488c-4b08-afd2-d262e29ddd1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:04.657864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7527a-488c-4b08-afd2-d262e29ddd1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:04.660887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7527a-488c-4b08-afd2-d262e29ddd1f service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:04.677055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 972/1954] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:04.735291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcfe8b-e203-4957-8ee4-e850fe89bf3c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:04.746817 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcfe8b-e203-4957-8ee4-e850fe89bf3c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:04.751143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ab716-9f8f-4271-8b55-9e844523fb21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:04.751791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ab716-9f8f-4271-8b55-9e844523fb21 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:04.752070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ab716-9f8f-4271-8b55-9e844523fb21 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:04.752349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ab716-9f8f-4271-8b55-9e844523fb21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:04.766083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:04.826382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ab716-9f8f-4271-8b55-9e844523fb21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:04.828011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ab716-9f8f-4271-8b55-9e844523fb21 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:04.840033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 983/1955] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:07.262348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7527a-488c-4b08-afd2-d262e29ddd1f service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:07.263877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-36b7527a-488c-4b08-afd2-d262e29ddd1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:07.338659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:07.369438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7527a-488c-4b08-afd2-d262e29ddd1f service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:07.378877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:07.379717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:07.380065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:07.380575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] PATH_INFO: `/v3/users/a865c90ddcd0486eb90a6634e9002424` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:07.382903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a865c90ddcd0486eb90a6634e9002424)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:07.385883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:07.483679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a865c90ddcd0486eb90a6634e9002424'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:07.494709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a865c90ddcd0486eb90a6634e9002424'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:07.495554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a865c90ddcd0486eb90a6634e9002424'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:07.511290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a865c90ddcd0486eb90a6634e9002424'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:07.512368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a865c90ddcd0486eb90a6634e9002424'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:07.530467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 973/1956] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:07 2022] DELETE /identity/v3/users/a865c90ddcd0486eb90a6634e9002424 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:07.535738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2432d7f-d413-4972-b435-88d41b2907c9 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:07.536360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2432d7f-d413-4972-b435-88d41b2907c9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:07.536360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2432d7f-d413-4972-b435-88d41b2907c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:07.561234 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-e2432d7f-d413-4972-b435-88d41b2907c9 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:07.562461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e2432d7f-d413-4972-b435-88d41b2907c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:07.633503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 984/1957] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:07.643950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:07.645645 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:07.708695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff19c-d826-431e-829a-6ef2fa24591b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:07.713002 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad73b86-377d-4322-9e7c-2d5b8e9b6e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:07.713623 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad73b86-377d-4322-9e7c-2d5b8e9b6e98 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:07.713899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad73b86-377d-4322-9e7c-2d5b8e9b6e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:07.714170 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad73b86-377d-4322-9e7c-2d5b8e9b6e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:07.723434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad73b86-377d-4322-9e7c-2d5b8e9b6e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:07.724854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad73b86-377d-4322-9e7c-2d5b8e9b6e98 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:07.735814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 974/1958] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:08.124492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2432d7f-d413-4972-b435-88d41b2907c9 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:08.126134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e2432d7f-d413-4972-b435-88d41b2907c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:08.156741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2432d7f-d413-4972-b435-88d41b2907c9 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:08.174107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:08.174804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:08.175961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:08.176246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] PATH_INFO: `/v3/projects/b0dbc8897f2c4366bdbb2a1119e51bd3` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:08.178002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0dbc8897f2c4366bdbb2a1119e51bd3)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:08.180661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:08.239185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0dbc8897f2c4366bdbb2a1119e51bd3', 'request_id': 'req-5268142d-8cdb-42d0-bfc8-94caf105e90e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.247812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0dbc8897f2c4366bdbb2a1119e51bd3', 'request_id': 'req-5268142d-8cdb-42d0-bfc8-94caf105e90e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.255086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0dbc8897f2c4366bdbb2a1119e51bd3', 'request_id': 'req-5268142d-8cdb-42d0-bfc8-94caf105e90e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.272108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] The token cache is being invalidate because project b0dbc8897f2c4366bdbb2a1119e51bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:08.272404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.273188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.276534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 985/1959] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:08 2022] DELETE /identity/v3/projects/b0dbc8897f2c4366bdbb2a1119e51bd3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:08.282068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad73b86-377d-4322-9e7c-2d5b8e9b6e98 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:08.292633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad73b86-377d-4322-9e7c-2d5b8e9b6e98 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:08.365850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:08.367146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:08.367712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:08.368146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] PATH_INFO: `/v3/users/71e3f23289c24819814ad688e604d6c2` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:08.369619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e3f23289c24819814ad688e604d6c2)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:08.371820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:08.378534 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:08.441895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e3f23289c24819814ad688e604d6c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.452068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e3f23289c24819814ad688e604d6c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.452814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e3f23289c24819814ad688e604d6c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.470579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e3f23289c24819814ad688e604d6c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.471365 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e3f23289c24819814ad688e604d6c2'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.487273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 975/1960] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:08 2022] DELETE /identity/v3/users/71e3f23289c24819814ad688e604d6c2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:08.756559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:08.758887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:08.780261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268142d-8cdb-42d0-bfc8-94caf105e90e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:08.833880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:08.868715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:08.869738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:08.870121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:08.870492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] PATH_INFO: `/v3/users/bc64623708ae477ba4c1efbb58dcb82b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:08.872126 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc64623708ae477ba4c1efbb58dcb82b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:08.875079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:08.956198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:08.958492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:08.963676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc64623708ae477ba4c1efbb58dcb82b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.966888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc64623708ae477ba4c1efbb58dcb82b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.968407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc64623708ae477ba4c1efbb58dcb82b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:08.988199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c95e0-353e-4f6e-8585-0296bd5bb969 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:08.994044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc64623708ae477ba4c1efbb58dcb82b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.000356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:09.001014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:09.001443 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:09.001677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] PATH_INFO: `/v3/projects/ff806fb00413498c99e2bde73e710528` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:09.002961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff806fb00413498c99e2bde73e710528)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:09.004992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:09.009951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2134d9e7-c689-4f5f-8204-a1b130a650b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc64623708ae477ba4c1efbb58dcb82b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.046937 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 986/1961] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:08 2022] DELETE /identity/v3/users/bc64623708ae477ba4c1efbb58dcb82b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:09.051438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a688-ed4b-4d0b-9d6d-26e41edad4f5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:09.051835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a688-ed4b-4d0b-9d6d-26e41edad4f5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:09.052181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a688-ed4b-4d0b-9d6d-26e41edad4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:09.077307 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff806fb00413498c99e2bde73e710528', 'request_id': 'req-9ba9fcd6-ce04-4333-aab5-e900d7441472'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.090290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff806fb00413498c99e2bde73e710528', 'request_id': 'req-9ba9fcd6-ce04-4333-aab5-e900d7441472'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.092356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-0986a688-ed4b-4d0b-9d6d-26e41edad4f5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:09.093955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0986a688-ed4b-4d0b-9d6d-26e41edad4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:09.103236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff806fb00413498c99e2bde73e710528', 'request_id': 'req-9ba9fcd6-ce04-4333-aab5-e900d7441472'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.124047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] The token cache is being invalidate because project ff806fb00413498c99e2bde73e710528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:09.124346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.125184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.127380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 976/1962] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:08 2022] DELETE /identity/v3/projects/ff806fb00413498c99e2bde73e710528 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:09.131746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:09.134551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:09.216976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 987/1963] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:09.231576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986a688-ed4b-4d0b-9d6d-26e41edad4f5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:09.233168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0986a688-ed4b-4d0b-9d6d-26e41edad4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:09.268176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9fcd6-ce04-4333-aab5-e900d7441472 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:09.275218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:09.275889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:09.276171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:09.276703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] PATH_INFO: `/v3/users/21c7c26ad5bc4deda2bc29eff926b7cd` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:09.278495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c7c26ad5bc4deda2bc29eff926b7cd)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:09.282792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:09.298189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:09.323986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986a688-ed4b-4d0b-9d6d-26e41edad4f5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:09.329021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fa988-5a36-4e85-a1b1-bc50f6644cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:09.329742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fa988-5a36-4e85-a1b1-bc50f6644cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:09.330001 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fa988-5a36-4e85-a1b1-bc50f6644cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:09.330403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fa988-5a36-4e85-a1b1-bc50f6644cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:09.341058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fa988-5a36-4e85-a1b1-bc50f6644cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:09.343041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fa988-5a36-4e85-a1b1-bc50f6644cb0 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:09.349007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:09.349372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c7c26ad5bc4deda2bc29eff926b7cd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.358751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 988/1964] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:09.359694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c7c26ad5bc4deda2bc29eff926b7cd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.360399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c7c26ad5bc4deda2bc29eff926b7cd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.379384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c7c26ad5bc4deda2bc29eff926b7cd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.380424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c7c26ad5bc4deda2bc29eff926b7cd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:09.400939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 977/1965] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:09 2022] DELETE /identity/v3/users/21c7c26ad5bc4deda2bc29eff926b7cd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:09.901242 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fa988-5a36-4e85-a1b1-bc50f6644cb0 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:09.902724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e52fa988-5a36-4e85-a1b1-bc50f6644cb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:09.930498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fa988-5a36-4e85-a1b1-bc50f6644cb0 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:10.029728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:10.030935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.031407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.031891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] PATH_INFO: `/v3/projects/3dfe4d2d64ed4e8195c6c179e5719f62` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.033417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dfe4d2d64ed4e8195c6c179e5719f62)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:10.035058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:10.084665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:10.088075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:10.104218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dfe4d2d64ed4e8195c6c179e5719f62', 'request_id': 'req-e8d2d22f-9414-483b-a92e-dabcf9126317'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.114557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9d8d4-30d9-499c-966b-493a70d89261 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:10.118253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dfe4d2d64ed4e8195c6c179e5719f62', 'request_id': 'req-e8d2d22f-9414-483b-a92e-dabcf9126317'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.126372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dfe4d2d64ed4e8195c6c179e5719f62', 'request_id': 'req-e8d2d22f-9414-483b-a92e-dabcf9126317'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.145486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] The token cache is being invalidate because project 3dfe4d2d64ed4e8195c6c179e5719f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:10.145787 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.146736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.150110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 989/1966] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:09 2022] DELETE /identity/v3/projects/3dfe4d2d64ed4e8195c6c179e5719f62 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:10.153854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:10.155500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:10.212570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:10.213227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.213652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.213932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] PATH_INFO: `/v3/projects/beedd1c48dbd4659b711fd0d4f3ddb99` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.215193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beedd1c48dbd4659b711fd0d4f3ddb99)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:10.217330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:10.247260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d22f-9414-483b-a92e-dabcf9126317 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:10.255635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:10.256300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.256584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.256856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] PATH_INFO: `/v3/users/2f1dbbf6169d4e2ea86ae4afe355ba30` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.258959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1dbbf6169d4e2ea86ae4afe355ba30)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:10.260989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:10.302441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beedd1c48dbd4659b711fd0d4f3ddb99', 'request_id': 'req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.313414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:10.316576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beedd1c48dbd4659b711fd0d4f3ddb99', 'request_id': 'req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.330870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beedd1c48dbd4659b711fd0d4f3ddb99', 'request_id': 'req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.335425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1dbbf6169d4e2ea86ae4afe355ba30'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.336230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1dbbf6169d4e2ea86ae4afe355ba30'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.337313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1dbbf6169d4e2ea86ae4afe355ba30'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.346860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1dbbf6169d4e2ea86ae4afe355ba30'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.350322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] The token cache is being invalidate because project beedd1c48dbd4659b711fd0d4f3ddb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:10.351192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.352518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cac9d9e1-b44d-4958-adc7-1fb5b31ac3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.360231 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 978/1967] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:10 2022] DELETE /identity/v3/projects/beedd1c48dbd4659b711fd0d4f3ddb99 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:10.361028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5985a44b-5da1-4cc8-ab5f-3ae9ebbb8a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1dbbf6169d4e2ea86ae4afe355ba30'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.362844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d9264-222a-4af0-96d4-7530233c6c62 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.363328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d9264-222a-4af0-96d4-7530233c6c62 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.363817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d9264-222a-4af0-96d4-7530233c6c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.386981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 990/1968] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:10 2022] DELETE /identity/v3/users/2f1dbbf6169d4e2ea86ae4afe355ba30 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:10.389888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-074d9264-222a-4af0-96d4-7530233c6c62 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:10.391616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-074d9264-222a-4af0-96d4-7530233c6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:10.412127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:10.508298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 979/1969] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:10.517295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3688f-952e-439e-bd36-697790105249 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.517581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3688f-952e-439e-bd36-697790105249 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.517857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3688f-952e-439e-bd36-697790105249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.546750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-62b3688f-952e-439e-bd36-697790105249 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:10.548073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-62b3688f-952e-439e-bd36-697790105249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:10.556620 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d9264-222a-4af0-96d4-7530233c6c62 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:10.558306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-074d9264-222a-4af0-96d4-7530233c6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:10.561171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 991/1970] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:10.565669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3688f-952e-439e-bd36-697790105249 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:10.573035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d9264-222a-4af0-96d4-7530233c6c62 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:10.576734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3688f-952e-439e-bd36-697790105249 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:10.581583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:10.581905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c376c-6bd0-45a8-afa9-bfd973c2d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:10.582524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c376c-6bd0-45a8-afa9-bfd973c2d17b admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.582831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c376c-6bd0-45a8-afa9-bfd973c2d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.583106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c376c-6bd0-45a8-afa9-bfd973c2d17b admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.583198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.583724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.583813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c376c-6bd0-45a8-afa9-bfd973c2d17b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:10.584058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c376c-6bd0-45a8-afa9-bfd973c2d17b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:10.584249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] PATH_INFO: `/v3/users/8e96e106cdd14b898253b1c90fb582da` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.585667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c376c-6bd0-45a8-afa9-bfd973c2d17b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:10.586260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e96e106cdd14b898253b1c90fb582da)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:10.593669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:10.598806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 992/1971] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:10.603831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c376c-6bd0-45a8-afa9-bfd973c2d17b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:10.618858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c376c-6bd0-45a8-afa9-bfd973c2d17b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:10.624150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3551b-6b7e-4cb1-be7b-94a39beedfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:10.624771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3551b-6b7e-4cb1-be7b-94a39beedfee admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.625051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3551b-6b7e-4cb1-be7b-94a39beedfee admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.625336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3551b-6b7e-4cb1-be7b-94a39beedfee admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.625967 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3551b-6b7e-4cb1-be7b-94a39beedfee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:10.628932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3551b-6b7e-4cb1-be7b-94a39beedfee admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:10.665021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 993/1972] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:10 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:47:10.666123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e96e106cdd14b898253b1c90fb582da'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.666405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3551b-6b7e-4cb1-be7b-94a39beedfee admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:10.676602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e96e106cdd14b898253b1c90fb582da'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.677364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e96e106cdd14b898253b1c90fb582da'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.697561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e96e106cdd14b898253b1c90fb582da'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.698308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e96e106cdd14b898253b1c90fb582da'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.719006 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 980/1973] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:10 2022] DELETE /identity/v3/users/8e96e106cdd14b898253b1c90fb582da => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:10.759065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:10.760853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:10.763159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3551b-6b7e-4cb1-be7b-94a39beedfee admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:10.884323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2feb6-e82b-480b-bb5a-db307141a85d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:10.890037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:10.890783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.891150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.891497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d310d-1707-4191-a5d6-f47b08d228e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:10.891639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] PATH_INFO: `/v3/projects/3d4198cce2ba496bac5ba54b5d7a7aa6` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.892415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d310d-1707-4191-a5d6-f47b08d228e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:10.892809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4198cce2ba496bac5ba54b5d7a7aa6)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:10.892920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d310d-1707-4191-a5d6-f47b08d228e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:10.893276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d310d-1707-4191-a5d6-f47b08d228e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:10.894489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d310d-1707-4191-a5d6-f47b08d228e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:10.897692 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d310d-1707-4191-a5d6-f47b08d228e3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:10.898889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:10.935523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 994/1974] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:10 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:10.936833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d310d-1707-4191-a5d6-f47b08d228e3 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:10.945069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-501d310d-1707-4191-a5d6-f47b08d228e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:10.950678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:10.955296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:10.963998 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d310d-1707-4191-a5d6-f47b08d228e3 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:10.967301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4198cce2ba496bac5ba54b5d7a7aa6', 'request_id': 'req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.977608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4198cce2ba496bac5ba54b5d7a7aa6', 'request_id': 'req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.985918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4198cce2ba496bac5ba54b5d7a7aa6', 'request_id': 'req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:10.999167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] The token cache is being invalidate because project 3d4198cce2ba496bac5ba54b5d7a7aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:10.999494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:11.000146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-164ba8b1-76a5-4607-a7c0-06fa3e85d8bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:11.004712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 981/1975] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:10 2022] DELETE /identity/v3/projects/3d4198cce2ba496bac5ba54b5d7a7aa6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:11.006810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6752d-95f1-4db6-bea1-3f8bdb75b1d5 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.007182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6752d-95f1-4db6-bea1-3f8bdb75b1d5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.007528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6752d-95f1-4db6-bea1-3f8bdb75b1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.034525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c5f6752d-95f1-4db6-bea1-3f8bdb75b1d5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:11.035405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c5f6752d-95f1-4db6-bea1-3f8bdb75b1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:11.093737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b24e5-dcad-4897-ac14-bc8a3a73253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.095506 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b24e5-dcad-4897-ac14-bc8a3a73253c admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.095996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b24e5-dcad-4897-ac14-bc8a3a73253c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.096490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b24e5-dcad-4897-ac14-bc8a3a73253c admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.097618 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b24e5-dcad-4897-ac14-bc8a3a73253c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.100474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b24e5-dcad-4897-ac14-bc8a3a73253c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.118192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 982/1976] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:11.120734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 995/1977] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:11.127580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6752d-95f1-4db6-bea1-3f8bdb75b1d5 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.127977 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8a3f-7569-4815-8f09-2933370da988 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.128462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8a3f-7569-4815-8f09-2933370da988 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.128803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8a3f-7569-4815-8f09-2933370da988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.131115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c5f6752d-95f1-4db6-bea1-3f8bdb75b1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:11.156485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6752d-95f1-4db6-bea1-3f8bdb75b1d5 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.184905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6aef8a3f-7569-4815-8f09-2933370da988 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:11.184905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6aef8a3f-7569-4815-8f09-2933370da988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:11.193749 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ef0e6-dc3e-415e-a70c-63bbffbb3cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.194599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef0e6-dc3e-415e-a70c-63bbffbb3cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.194926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef0e6-dc3e-415e-a70c-63bbffbb3cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.195193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef0e6-dc3e-415e-a70c-63bbffbb3cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.196939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ef0e6-dc3e-415e-a70c-63bbffbb3cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.198546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ef0e6-dc3e-415e-a70c-63bbffbb3cf1 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.212024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 996/1978] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:11.212905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8a3f-7569-4815-8f09-2933370da988 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.214659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6aef8a3f-7569-4815-8f09-2933370da988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:11.221942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 983/1979] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:11.222999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ef0e6-dc3e-415e-a70c-63bbffbb3cf1 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.232794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8a3f-7569-4815-8f09-2933370da988 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.241370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ef0e6-dc3e-415e-a70c-63bbffbb3cf1 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.243220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.244221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.244565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.244916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] PATH_INFO: `/v3/projects/f844197232cc4b5597f38a410150f154` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.247553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f844197232cc4b5597f38a410150f154)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.250191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.250332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3256b-5219-42ad-a2ae-df84b647b1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.250803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3256b-5219-42ad-a2ae-df84b647b1ae admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.251071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3256b-5219-42ad-a2ae-df84b647b1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.251356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3256b-5219-42ad-a2ae-df84b647b1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.252022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3256b-5219-42ad-a2ae-df84b647b1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:11.252744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3256b-5219-42ad-a2ae-df84b647b1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.254895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3256b-5219-42ad-a2ae-df84b647b1ae admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.282166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 984/1980] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:11.283319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3256b-5219-42ad-a2ae-df84b647b1ae admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.294104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3256b-5219-42ad-a2ae-df84b647b1ae admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.299598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721ec9f-6ec7-432b-85f0-31567ce7665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.300445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721ec9f-6ec7-432b-85f0-31567ce7665b admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.300726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721ec9f-6ec7-432b-85f0-31567ce7665b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.301002 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721ec9f-6ec7-432b-85f0-31567ce7665b admin admin] PATH_INFO: `/v3/projects/fda5d8095d0d43b39e55dbf283b0831b/users/48565602421f416baa3e70519222ffa7/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.319132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721ec9f-6ec7-432b-85f0-31567ce7665b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda5d8095d0d43b39e55dbf283b0831b, user_id=48565602421f416baa3e70519222ffa7, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.319768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f844197232cc4b5597f38a410150f154', 'request_id': 'req-15f104c1-e853-4f22-8482-fc0b18798491'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:11.323596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721ec9f-6ec7-432b-85f0-31567ce7665b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.327067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f844197232cc4b5597f38a410150f154', 'request_id': 'req-15f104c1-e853-4f22-8482-fc0b18798491'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:11.334688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f844197232cc4b5597f38a410150f154', 'request_id': 'req-15f104c1-e853-4f22-8482-fc0b18798491'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:11.342224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 985/1981] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:11 2022] PUT /identity/v3/projects/fda5d8095d0d43b39e55dbf283b0831b/users/48565602421f416baa3e70519222ffa7/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:11.343183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721ec9f-6ec7-432b-85f0-31567ce7665b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.360642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] The token cache is being invalidate because project f844197232cc4b5597f38a410150f154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:11.361404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:11.362172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-15f104c1-e853-4f22-8482-fc0b18798491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:11.363825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 997/1982] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:11 2022] DELETE /identity/v3/projects/f844197232cc4b5597f38a410150f154 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:11.365103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543bbff-0ba2-4987-a860-81902772f459 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.365456 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543bbff-0ba2-4987-a860-81902772f459 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.365821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543bbff-0ba2-4987-a860-81902772f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.395528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6543bbff-0ba2-4987-a860-81902772f459 None None] MFA Rules not processed for user `48565602421f416baa3e70519222ffa7`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:11.396794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6543bbff-0ba2-4987-a860-81902772f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:11.419660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721ec9f-6ec7-432b-85f0-31567ce7665b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.425839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406dd62-1e06-4562-b62f-3f4f9389eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.426577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406dd62-1e06-4562-b62f-3f4f9389eeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.427011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406dd62-1e06-4562-b62f-3f4f9389eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.427346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406dd62-1e06-4562-b62f-3f4f9389eeb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.428053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406dd62-1e06-4562-b62f-3f4f9389eeb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.430208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406dd62-1e06-4562-b62f-3f4f9389eeb6 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.455054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:11.480311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 986/1983] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:11.484735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30405a-2c70-4987-a9c4-f97c13829afa None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.484735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30405a-2c70-4987-a9c4-f97c13829afa None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.484735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30405a-2c70-4987-a9c4-f97c13829afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.500522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 998/1984] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:11.501467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543bbff-0ba2-4987-a860-81902772f459 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.505460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6543bbff-0ba2-4987-a860-81902772f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:11.511228 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-1d30405a-2c70-4987-a9c4-f97c13829afa None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:11.512652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1d30405a-2c70-4987-a9c4-f97c13829afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:11.520378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:11.530105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543bbff-0ba2-4987-a860-81902772f459 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.631936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 987/1985] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:11.633368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641df43-3773-4d09-bf20-881c583533e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.633527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30405a-2c70-4987-a9c4-f97c13829afa None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.634696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641df43-3773-4d09-bf20-881c583533e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.635116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641df43-3773-4d09-bf20-881c583533e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.635469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641df43-3773-4d09-bf20-881c583533e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.636945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641df43-3773-4d09-bf20-881c583533e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.639363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641df43-3773-4d09-bf20-881c583533e7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.642297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1d30405a-2c70-4987-a9c4-f97c13829afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:11.668878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30405a-2c70-4987-a9c4-f97c13829afa None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.677073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769858e-3ea5-4398-9b4e-d152f4181c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.677686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769858e-3ea5-4398-9b4e-d152f4181c45 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.678178 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769858e-3ea5-4398-9b4e-d152f4181c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.678462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769858e-3ea5-4398-9b4e-d152f4181c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.679133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769858e-3ea5-4398-9b4e-d152f4181c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.682803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769858e-3ea5-4398-9b4e-d152f4181c45 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.689399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 999/1986] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:11.690978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a9c08-6cf6-4ae1-8d7d-52f8c09c7806 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.691122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a9c08-6cf6-4ae1-8d7d-52f8c09c7806 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.691352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a9c08-6cf6-4ae1-8d7d-52f8c09c7806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.730129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d71a9c08-6cf6-4ae1-8d7d-52f8c09c7806 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:11.732229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d71a9c08-6cf6-4ae1-8d7d-52f8c09c7806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:11.741636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1000/1987] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:11.743201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 988/1988] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:11.743350 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a9c08-6cf6-4ae1-8d7d-52f8c09c7806 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.746191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769858e-3ea5-4398-9b4e-d152f4181c45 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.759545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a9c08-6cf6-4ae1-8d7d-52f8c09c7806 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.831506 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769858e-3ea5-4398-9b4e-d152f4181c45 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.836673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e2d69-f1c6-453f-aa45-1b437ceadc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.837317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e2d69-f1c6-453f-aa45-1b437ceadc1e admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.837575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e2d69-f1c6-453f-aa45-1b437ceadc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.837874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e2d69-f1c6-453f-aa45-1b437ceadc1e admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.838530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e2d69-f1c6-453f-aa45-1b437ceadc1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:11.838874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e2d69-f1c6-453f-aa45-1b437ceadc1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.839059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7418d-21aa-4e1c-890a-bb16128446bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.839672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7418d-21aa-4e1c-890a-bb16128446bc admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.839950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7418d-21aa-4e1c-890a-bb16128446bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.840222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7418d-21aa-4e1c-890a-bb16128446bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.840480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e2d69-f1c6-453f-aa45-1b437ceadc1e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.840858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7418d-21aa-4e1c-890a-bb16128446bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.842478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7418d-21aa-4e1c-890a-bb16128446bc admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.853044 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1001/1989] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:11.853503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 989/1990] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:47:11.857194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e2d69-f1c6-453f-aa45-1b437ceadc1e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.857318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7418d-21aa-4e1c-890a-bb16128446bc admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.868267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7418d-21aa-4e1c-890a-bb16128446bc admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.869132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e2d69-f1c6-453f-aa45-1b437ceadc1e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.873079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541339b-893d-4350-8afc-f6c5f11344a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.873783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541339b-893d-4350-8afc-f6c5f11344a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.873930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bd952-1255-44e8-b231-279e7f1a9228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.874085 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541339b-893d-4350-8afc-f6c5f11344a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.874335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541339b-893d-4350-8afc-f6c5f11344a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.874443 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bd952-1255-44e8-b231-279e7f1a9228 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.874732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bd952-1255-44e8-b231-279e7f1a9228 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.874985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541339b-893d-4350-8afc-f6c5f11344a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.875089 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bd952-1255-44e8-b231-279e7f1a9228 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.875670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bd952-1255-44e8-b231-279e7f1a9228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.876900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541339b-893d-4350-8afc-f6c5f11344a6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.877253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bd952-1255-44e8-b231-279e7f1a9228 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.889185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 990/1991] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:47:11.889836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bd952-1255-44e8-b231-279e7f1a9228 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.900969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bd952-1255-44e8-b231-279e7f1a9228 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.904367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1002/1992] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:11.905835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203cd6a-0204-4f4f-bfb2-d0c27a8f3856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.906438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203cd6a-0204-4f4f-bfb2-d0c27a8f3856 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.906733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203cd6a-0204-4f4f-bfb2-d0c27a8f3856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.907028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203cd6a-0204-4f4f-bfb2-d0c27a8f3856 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.907814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541339b-893d-4350-8afc-f6c5f11344a6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.907946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203cd6a-0204-4f4f-bfb2-d0c27a8f3856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.909947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203cd6a-0204-4f4f-bfb2-d0c27a8f3856 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.918990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541339b-893d-4350-8afc-f6c5f11344a6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:11.923818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fde14-ae59-4276-b672-5aec65994c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:11.924483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fde14-ae59-4276-b672-5aec65994c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:11.924767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fde14-ae59-4276-b672-5aec65994c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:11.925169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fde14-ae59-4276-b672-5aec65994c0d admin admin] PATH_INFO: `/v3/projects/1ebfba5550a445bea63fc76202842244/users/2744b4fcf9e7457daf37cce547692381/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:11.943351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 991/1993] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:11.944306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203cd6a-0204-4f4f-bfb2-d0c27a8f3856 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.958437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fde14-ae59-4276-b672-5aec65994c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebfba5550a445bea63fc76202842244, user_id=2744b4fcf9e7457daf37cce547692381, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:11.962503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fde14-ae59-4276-b672-5aec65994c0d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:11.978086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1003/1994] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:11 2022] PUT /identity/v3/projects/1ebfba5550a445bea63fc76202842244/users/2744b4fcf9e7457daf37cce547692381/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:11.979374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fde14-ae59-4276-b672-5aec65994c0d admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:11.990509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:12.013557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203cd6a-0204-4f4f-bfb2-d0c27a8f3856 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.035195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:12.054485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fde14-ae59-4276-b672-5aec65994c0d admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.059862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c6e34-00fd-4c6c-ae85-9137e17d2792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.060480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c6e34-00fd-4c6c-ae85-9137e17d2792 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.060774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c6e34-00fd-4c6c-ae85-9137e17d2792 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.061033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c6e34-00fd-4c6c-ae85-9137e17d2792 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.061652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c6e34-00fd-4c6c-ae85-9137e17d2792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.063914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c6e34-00fd-4c6c-ae85-9137e17d2792 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.072605 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b239ae-ff36-4263-abb7-c1b36626dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.073275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b239ae-ff36-4263-abb7-c1b36626dc83 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.073495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b239ae-ff36-4263-abb7-c1b36626dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.073780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b239ae-ff36-4263-abb7-c1b36626dc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.074806 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b239ae-ff36-4263-abb7-c1b36626dc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.076327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b239ae-ff36-4263-abb7-c1b36626dc83 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.088783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 992/1995] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:12.090024 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09564d1b-196c-479b-b9ef-ec831c7ce1d0 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.090313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09564d1b-196c-479b-b9ef-ec831c7ce1d0 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.090590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09564d1b-196c-479b-b9ef-ec831c7ce1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.096918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1004/1996] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:11 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:12.097714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c6e34-00fd-4c6c-ae85-9137e17d2792 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.109655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c6e34-00fd-4c6c-ae85-9137e17d2792 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.115232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a594-7d3c-40a5-b977-eaa5e659fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.115907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a594-7d3c-40a5-b977-eaa5e659fa6b admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.116185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a594-7d3c-40a5-b977-eaa5e659fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.116458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a594-7d3c-40a5-b977-eaa5e659fa6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.117802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852a594-7d3c-40a5-b977-eaa5e659fa6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.119732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852a594-7d3c-40a5-b977-eaa5e659fa6b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.123142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-09564d1b-196c-479b-b9ef-ec831c7ce1d0 None None] MFA Rules not processed for user `2744b4fcf9e7457daf37cce547692381`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:12.124414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-09564d1b-196c-479b-b9ef-ec831c7ce1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:12.132109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1005/1997] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:12.133176 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a594-7d3c-40a5-b977-eaa5e659fa6b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.143449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a594-7d3c-40a5-b977-eaa5e659fa6b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.149303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ffeeb-56e7-4682-bd4b-3d9aacf1d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.149908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ffeeb-56e7-4682-bd4b-3d9aacf1d256 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.150188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ffeeb-56e7-4682-bd4b-3d9aacf1d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.150460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ffeeb-56e7-4682-bd4b-3d9aacf1d256 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.151130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ffeeb-56e7-4682-bd4b-3d9aacf1d256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.152752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ffeeb-56e7-4682-bd4b-3d9aacf1d256 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.165709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1006/1998] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:12.166559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ffeeb-56e7-4682-bd4b-3d9aacf1d256 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.177813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ffeeb-56e7-4682-bd4b-3d9aacf1d256 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.184036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae7e51-d064-423c-9d86-bc56adace230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.184709 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae7e51-d064-423c-9d86-bc56adace230 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.184994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae7e51-d064-423c-9d86-bc56adace230 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.185271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae7e51-d064-423c-9d86-bc56adace230 admin admin] PATH_INFO: `/v3/projects/67e0f19a725a436c9962bdb423071bc9/users/dd40111600864c0f929955a8afb6b746/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.223140 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae7e51-d064-423c-9d86-bc56adace230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e0f19a725a436c9962bdb423071bc9, user_id=dd40111600864c0f929955a8afb6b746, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.227857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae7e51-d064-423c-9d86-bc56adace230 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.251573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 993/1999] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:12.253927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09564d1b-196c-479b-b9ef-ec831c7ce1d0 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.254815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1007/2000] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:12 2022] PUT /identity/v3/projects/67e0f19a725a436c9962bdb423071bc9/users/dd40111600864c0f929955a8afb6b746/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:12.259265 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae7e51-d064-423c-9d86-bc56adace230 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.277403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09564d1b-196c-479b-b9ef-ec831c7ce1d0 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.344469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae7e51-d064-423c-9d86-bc56adace230 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.344731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44ec3-edc7-4e23-9f7d-8fd19aebd1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.345343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44ec3-edc7-4e23-9f7d-8fd19aebd1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.345622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44ec3-edc7-4e23-9f7d-8fd19aebd1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.345909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44ec3-edc7-4e23-9f7d-8fd19aebd1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.346647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc44ec3-edc7-4e23-9f7d-8fd19aebd1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.348271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc44ec3-edc7-4e23-9f7d-8fd19aebd1f7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.350261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da60e9-260d-48dc-b2db-61ff56eecace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.351104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da60e9-260d-48dc-b2db-61ff56eecace admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.352585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da60e9-260d-48dc-b2db-61ff56eecace admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.353137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da60e9-260d-48dc-b2db-61ff56eecace admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.354108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da60e9-260d-48dc-b2db-61ff56eecace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.356590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da60e9-260d-48dc-b2db-61ff56eecace admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.360926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 994/2001] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:12.362274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860af98a-6422-46f6-b72a-797dd57432fd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.362561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860af98a-6422-46f6-b72a-797dd57432fd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.363072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860af98a-6422-46f6-b72a-797dd57432fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.387898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1008/2002] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:12 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:12.389029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da60e9-260d-48dc-b2db-61ff56eecace admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.393279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:12.412230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-860af98a-6422-46f6-b72a-797dd57432fd None None] MFA Rules not processed for user `dd40111600864c0f929955a8afb6b746`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:12.413461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-860af98a-6422-46f6-b72a-797dd57432fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:12.460647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da60e9-260d-48dc-b2db-61ff56eecace admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.466494 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d9805-d3a7-4677-924c-380707455a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.467371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d9805-d3a7-4677-924c-380707455a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.467653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d9805-d3a7-4677-924c-380707455a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.467926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d9805-d3a7-4677-924c-380707455a5a admin admin] PATH_INFO: `/v3/projects/6fee2d4b94df489e80125bafe3dfe36a/users/eafc03d253f94a22b2b517cbcfc28fcb/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.483361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 995/2003] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:12.484281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860af98a-6422-46f6-b72a-797dd57432fd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.485834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d9805-d3a7-4677-924c-380707455a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fee2d4b94df489e80125bafe3dfe36a, user_id=eafc03d253f94a22b2b517cbcfc28fcb, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.488621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d9805-d3a7-4677-924c-380707455a5a admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.490889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:12.495917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860af98a-6422-46f6-b72a-797dd57432fd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.500760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab4ecb-1b41-4cbe-9b2b-cb89a2b9c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.501374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab4ecb-1b41-4cbe-9b2b-cb89a2b9c489 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.501658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab4ecb-1b41-4cbe-9b2b-cb89a2b9c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.501926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab4ecb-1b41-4cbe-9b2b-cb89a2b9c489 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.502551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab4ecb-1b41-4cbe-9b2b-cb89a2b9c489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.503942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1009/2004] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:12 2022] PUT /identity/v3/projects/6fee2d4b94df489e80125bafe3dfe36a/users/eafc03d253f94a22b2b517cbcfc28fcb/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:12.504500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab4ecb-1b41-4cbe-9b2b-cb89a2b9c489 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.504802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d9805-d3a7-4677-924c-380707455a5a admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.527076 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 996/2005] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:12 2022] POST /identity/v3/users => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:12.528375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604fb03-4b8c-428d-91ca-10afa6335741 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.528661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604fb03-4b8c-428d-91ca-10afa6335741 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.528965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604fb03-4b8c-428d-91ca-10afa6335741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.556902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4604fb03-4b8c-428d-91ca-10afa6335741 None None] MFA Rules not processed for user `eafc03d253f94a22b2b517cbcfc28fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:12.558141 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4604fb03-4b8c-428d-91ca-10afa6335741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:12.578662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d9805-d3a7-4677-924c-380707455a5a admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.583363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafc999-ff5b-437d-8ec8-0c5f8def3fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.583969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafc999-ff5b-437d-8ec8-0c5f8def3fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.584244 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafc999-ff5b-437d-8ec8-0c5f8def3fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.584514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafc999-ff5b-437d-8ec8-0c5f8def3fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.585146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafc999-ff5b-437d-8ec8-0c5f8def3fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.587108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafc999-ff5b-437d-8ec8-0c5f8def3fd7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.614204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1010/2006] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:12 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:12.618815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafc999-ff5b-437d-8ec8-0c5f8def3fd7 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.626140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 997/2007] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:12.627027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604fb03-4b8c-428d-91ca-10afa6335741 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.639010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604fb03-4b8c-428d-91ca-10afa6335741 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.699237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafc999-ff5b-437d-8ec8-0c5f8def3fd7 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.708156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb81c8a-c95d-463f-b79f-cd7a8d2e90d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.708763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb81c8a-c95d-463f-b79f-cd7a8d2e90d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.709040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb81c8a-c95d-463f-b79f-cd7a8d2e90d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.709309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb81c8a-c95d-463f-b79f-cd7a8d2e90d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.710077 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb81c8a-c95d-463f-b79f-cd7a8d2e90d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.712363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb81c8a-c95d-463f-b79f-cd7a8d2e90d3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.716037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881241ea-0e41-46cf-8b87-985bb7a597a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.716662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881241ea-0e41-46cf-8b87-985bb7a597a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.716947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881241ea-0e41-46cf-8b87-985bb7a597a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.717220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881241ea-0e41-46cf-8b87-985bb7a597a1 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.717855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881241ea-0e41-46cf-8b87-985bb7a597a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.719888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881241ea-0e41-46cf-8b87-985bb7a597a1 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.723202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1011/2008] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:12.724020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb81c8a-c95d-463f-b79f-cd7a8d2e90d3 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.735043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb81c8a-c95d-463f-b79f-cd7a8d2e90d3 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.736696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:12.740464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b894690-ebfe-4b8c-80a7-56ee02cd2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.741075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b894690-ebfe-4b8c-80a7-56ee02cd2be0 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.741400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b894690-ebfe-4b8c-80a7-56ee02cd2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.741718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b894690-ebfe-4b8c-80a7-56ee02cd2be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.742540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b894690-ebfe-4b8c-80a7-56ee02cd2be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.744606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b894690-ebfe-4b8c-80a7-56ee02cd2be0 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.747014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 998/2009] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:12 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:12.748436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881241ea-0e41-46cf-8b87-985bb7a597a1 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.759081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881241ea-0e41-46cf-8b87-985bb7a597a1 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.763942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b67f14-02ea-4360-a1fb-a02ff2b569c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.764654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b67f14-02ea-4360-a1fb-a02ff2b569c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.764954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b67f14-02ea-4360-a1fb-a02ff2b569c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.765286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b67f14-02ea-4360-a1fb-a02ff2b569c6 admin admin] PATH_INFO: `/v3/projects/24152d0769a445d0b37562dddd4c1833/users/b239f03c769c4cfba93fb702fb837541/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.775603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1012/2010] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:12 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:12.775603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b894690-ebfe-4b8c-80a7-56ee02cd2be0 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.790691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b67f14-02ea-4360-a1fb-a02ff2b569c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24152d0769a445d0b37562dddd4c1833, user_id=b239f03c769c4cfba93fb702fb837541, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.796772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b67f14-02ea-4360-a1fb-a02ff2b569c6 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.815191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 999/2011] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:12 2022] PUT /identity/v3/projects/24152d0769a445d0b37562dddd4c1833/users/b239f03c769c4cfba93fb702fb837541/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:12.815994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b67f14-02ea-4360-a1fb-a02ff2b569c6 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.847099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:12.860184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b894690-ebfe-4b8c-80a7-56ee02cd2be0 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.885347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b67f14-02ea-4360-a1fb-a02ff2b569c6 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.890727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ec79d-72c3-480f-8bf5-618a0768d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.891375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec79d-72c3-480f-8bf5-618a0768d51b admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.891653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec79d-72c3-480f-8bf5-618a0768d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.892039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec79d-72c3-480f-8bf5-618a0768d51b admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.892675 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ec79d-72c3-480f-8bf5-618a0768d51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.895093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ec79d-72c3-480f-8bf5-618a0768d51b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.920217 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1000/2012] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:12 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:12.920927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ec79d-72c3-480f-8bf5-618a0768d51b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.923732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c54952-df38-4eb9-8b4e-54b16ffbec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.924484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c54952-df38-4eb9-8b4e-54b16ffbec46 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.924781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c54952-df38-4eb9-8b4e-54b16ffbec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.925052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c54952-df38-4eb9-8b4e-54b16ffbec46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.925699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c54952-df38-4eb9-8b4e-54b16ffbec46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.927345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c54952-df38-4eb9-8b4e-54b16ffbec46 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.934661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ec79d-72c3-480f-8bf5-618a0768d51b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.941052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1013/2013] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:12.941052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c54952-df38-4eb9-8b4e-54b16ffbec46 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.942923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900a05a-70a8-4b44-a1e0-d574235f93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.943535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900a05a-70a8-4b44-a1e0-d574235f93c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.943813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900a05a-70a8-4b44-a1e0-d574235f93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.944077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900a05a-70a8-4b44-a1e0-d574235f93c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.944710 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900a05a-70a8-4b44-a1e0-d574235f93c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.946878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900a05a-70a8-4b44-a1e0-d574235f93c7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.952675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c54952-df38-4eb9-8b4e-54b16ffbec46 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.960446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1001/2014] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:12.960754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890780-786f-4bbe-a5fc-8ce44f129817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.960754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890780-786f-4bbe-a5fc-8ce44f129817 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.961893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900a05a-70a8-4b44-a1e0-d574235f93c7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.962005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890780-786f-4bbe-a5fc-8ce44f129817 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.962005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890780-786f-4bbe-a5fc-8ce44f129817 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.962005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e890780-786f-4bbe-a5fc-8ce44f129817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.962005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e890780-786f-4bbe-a5fc-8ce44f129817 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.969599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900a05a-70a8-4b44-a1e0-d574235f93c7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.974700 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e1dc9-c50d-452d-acf7-b3f87714febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.975399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e1dc9-c50d-452d-acf7-b3f87714febb admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.975825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e1dc9-c50d-452d-acf7-b3f87714febb admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.976108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e1dc9-c50d-452d-acf7-b3f87714febb admin admin] PATH_INFO: `/v3/projects/1389838541504f0fbba53a7f642b4983/users/b9519cd7503240cda2e9c0a7c18b4da8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.977009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1014/2015] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:12.977853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890780-786f-4bbe-a5fc-8ce44f129817 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:12.989784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890780-786f-4bbe-a5fc-8ce44f129817 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:12.992268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e1dc9-c50d-452d-acf7-b3f87714febb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1389838541504f0fbba53a7f642b4983, user_id=b9519cd7503240cda2e9c0a7c18b4da8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:12.994514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263767d-83ee-4a16-a5ea-6081c871ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:12.995143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e1dc9-c50d-452d-acf7-b3f87714febb admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:12.995251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263767d-83ee-4a16-a5ea-6081c871ba06 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:12.995489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263767d-83ee-4a16-a5ea-6081c871ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:12.995781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263767d-83ee-4a16-a5ea-6081c871ba06 admin admin] PATH_INFO: `/v3/projects/24152d0769a445d0b37562dddd4c1833/users/b239f03c769c4cfba93fb702fb837541/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:12.997769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263767d-83ee-4a16-a5ea-6081c871ba06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24152d0769a445d0b37562dddd4c1833, user_id=b239f03c769c4cfba93fb702fb837541, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.000736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263767d-83ee-4a16-a5ea-6081c871ba06 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.009217 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1002/2016] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:12 2022] PUT /identity/v3/projects/1389838541504f0fbba53a7f642b4983/users/b9519cd7503240cda2e9c0a7c18b4da8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:13.013109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e1dc9-c50d-452d-acf7-b3f87714febb admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.013644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1015/2017] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:12 2022] PUT /identity/v3/projects/24152d0769a445d0b37562dddd4c1833/users/b239f03c769c4cfba93fb702fb837541/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:13.014571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263767d-83ee-4a16-a5ea-6081c871ba06 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.080394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e1dc9-c50d-452d-acf7-b3f87714febb admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:13.089864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263767d-83ee-4a16-a5ea-6081c871ba06 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:13.094517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beeb77b-fec4-4e82-a7d9-3346d03a33f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:13.095153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeb77b-fec4-4e82-a7d9-3346d03a33f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.095432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeb77b-fec4-4e82-a7d9-3346d03a33f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.095701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeb77b-fec4-4e82-a7d9-3346d03a33f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.096641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beeb77b-fec4-4e82-a7d9-3346d03a33f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.097930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beeb77b-fec4-4e82-a7d9-3346d03a33f7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.108292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1016/2018] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:13.109589 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a1b89-1519-4308-ac69-8bdd6942cc52 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.109871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a1b89-1519-4308-ac69-8bdd6942cc52 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.110214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a1b89-1519-4308-ac69-8bdd6942cc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.114175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:13.138296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-fe0a1b89-1519-4308-ac69-8bdd6942cc52 None None] MFA Rules not processed for user `b239f03c769c4cfba93fb702fb837541`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:13.139566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-fe0a1b89-1519-4308-ac69-8bdd6942cc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:13.141030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20258f9a-82c0-4b6e-82e9-cd800b1b272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:13.141695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20258f9a-82c0-4b6e-82e9-cd800b1b272f admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.141969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20258f9a-82c0-4b6e-82e9-cd800b1b272f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.142238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20258f9a-82c0-4b6e-82e9-cd800b1b272f admin admin] PATH_INFO: `/v3/projects/c06e6a1b01b94b2eaa08a637bb9aa97b/users/0f9b7af7120740499c8d42630a9e5a2b/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.158027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20258f9a-82c0-4b6e-82e9-cd800b1b272f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06e6a1b01b94b2eaa08a637bb9aa97b, user_id=0f9b7af7120740499c8d42630a9e5a2b, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.160711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20258f9a-82c0-4b6e-82e9-cd800b1b272f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.174799 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1003/2019] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:13 2022] PUT /identity/v3/projects/c06e6a1b01b94b2eaa08a637bb9aa97b/users/0f9b7af7120740499c8d42630a9e5a2b/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:13.175485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20258f9a-82c0-4b6e-82e9-cd800b1b272f admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.209868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:13.222413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1017/2020] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:13.223178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a1b89-1519-4308-ac69-8bdd6942cc52 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.234028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a1b89-1519-4308-ac69-8bdd6942cc52 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:13.250228 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20258f9a-82c0-4b6e-82e9-cd800b1b272f admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:13.255034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659c26c-708d-4773-9dc9-dd3b1e8c44ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:13.255704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659c26c-708d-4773-9dc9-dd3b1e8c44ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.255986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659c26c-708d-4773-9dc9-dd3b1e8c44ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.256256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659c26c-708d-4773-9dc9-dd3b1e8c44ec admin admin] PATH_INFO: `/v3/projects/1389838541504f0fbba53a7f642b4983/users/b9519cd7503240cda2e9c0a7c18b4da8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.259054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659c26c-708d-4773-9dc9-dd3b1e8c44ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1389838541504f0fbba53a7f642b4983, user_id=b9519cd7503240cda2e9c0a7c18b4da8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.261691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659c26c-708d-4773-9dc9-dd3b1e8c44ec admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.272398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1004/2021] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:13 2022] PUT /identity/v3/projects/1389838541504f0fbba53a7f642b4983/users/b9519cd7503240cda2e9c0a7c18b4da8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:13.273296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659c26c-708d-4773-9dc9-dd3b1e8c44ec admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.275292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e659c26c-708d-4773-9dc9-dd3b1e8c44ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:13.302696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4b941-dc82-437b-a05c-3db8b9929788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:13.303351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b941-dc82-437b-a05c-3db8b9929788 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.303650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b941-dc82-437b-a05c-3db8b9929788 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.303910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b941-dc82-437b-a05c-3db8b9929788 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.305117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4b941-dc82-437b-a05c-3db8b9929788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.306944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4b941-dc82-437b-a05c-3db8b9929788 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.317036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1018/2022] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:13.318267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226980-2808-4446-91f5-2c1969ac5f3b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.318837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226980-2808-4446-91f5-2c1969ac5f3b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.318837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226980-2808-4446-91f5-2c1969ac5f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.336343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659c26c-708d-4773-9dc9-dd3b1e8c44ec admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:13.340008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437fc7-2143-4cd2-9631-b173840a9921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:13.340615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437fc7-2143-4cd2-9631-b173840a9921 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.340890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437fc7-2143-4cd2-9631-b173840a9921 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.341160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437fc7-2143-4cd2-9631-b173840a9921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.348694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-7b226980-2808-4446-91f5-2c1969ac5f3b None None] MFA Rules not processed for user `b9519cd7503240cda2e9c0a7c18b4da8`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:13.349988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7b226980-2808-4446-91f5-2c1969ac5f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:13.408761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89437fc7-2143-4cd2-9631-b173840a9921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.410422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89437fc7-2143-4cd2-9631-b173840a9921 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.425765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1005/2023] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:13.426646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437fc7-2143-4cd2-9631-b173840a9921 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.432097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:13.446416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1019/2024] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:13.455900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226980-2808-4446-91f5-2c1969ac5f3b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.457357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7b226980-2808-4446-91f5-2c1969ac5f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:13.470417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226980-2808-4446-91f5-2c1969ac5f3b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:13.474231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57a1c9-ccdc-4fa2-9cc5-8ad48bf694a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:13.475066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57a1c9-ccdc-4fa2-9cc5-8ad48bf694a9 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.475415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57a1c9-ccdc-4fa2-9cc5-8ad48bf694a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.475759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57a1c9-ccdc-4fa2-9cc5-8ad48bf694a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.488485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57a1c9-ccdc-4fa2-9cc5-8ad48bf694a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.489954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57a1c9-ccdc-4fa2-9cc5-8ad48bf694a9 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.504521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1020/2025] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:13.532060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437fc7-2143-4cd2-9631-b173840a9921 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:13.546378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c6a74-592e-4664-bc0e-5b6c69a6e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:13.547446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c6a74-592e-4664-bc0e-5b6c69a6e17d admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.551483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c6a74-592e-4664-bc0e-5b6c69a6e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.551775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c6a74-592e-4664-bc0e-5b6c69a6e17d admin admin] PATH_INFO: `/v3/projects/c06e6a1b01b94b2eaa08a637bb9aa97b/users/0f9b7af7120740499c8d42630a9e5a2b/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.558744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c6a74-592e-4664-bc0e-5b6c69a6e17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06e6a1b01b94b2eaa08a637bb9aa97b, user_id=0f9b7af7120740499c8d42630a9e5a2b, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.560398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57a1c9-ccdc-4fa2-9cc5-8ad48bf694a9 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.565342 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c6a74-592e-4664-bc0e-5b6c69a6e17d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.580483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57a1c9-ccdc-4fa2-9cc5-8ad48bf694a9 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:13.596654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1006/2026] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:13 2022] PUT /identity/v3/projects/c06e6a1b01b94b2eaa08a637bb9aa97b/users/0f9b7af7120740499c8d42630a9e5a2b/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:13.597705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c6a74-592e-4664-bc0e-5b6c69a6e17d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.658010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f19dd3-2eb7-4daa-8c19-1e433da61ae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:13.658535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f19dd3-2eb7-4daa-8c19-1e433da61ae2 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.658844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f19dd3-2eb7-4daa-8c19-1e433da61ae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.659121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f19dd3-2eb7-4daa-8c19-1e433da61ae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.672481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c6a74-592e-4664-bc0e-5b6c69a6e17d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:13.674668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:13.676770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5261d3f-c192-4f1f-a53d-5e94edec729b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:13.677495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5261d3f-c192-4f1f-a53d-5e94edec729b service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.677875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5261d3f-c192-4f1f-a53d-5e94edec729b service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.678224 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5261d3f-c192-4f1f-a53d-5e94edec729b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.728304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f19dd3-2eb7-4daa-8c19-1e433da61ae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.730013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f19dd3-2eb7-4daa-8c19-1e433da61ae2 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.739385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1021/2027] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:13.740667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e89b5-45d9-45b5-8da9-6d0f55344eb5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.740956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e89b5-45d9-45b5-8da9-6d0f55344eb5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.741241 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e89b5-45d9-45b5-8da9-6d0f55344eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.749144 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5261d3f-c192-4f1f-a53d-5e94edec729b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:13.750703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5261d3f-c192-4f1f-a53d-5e94edec729b service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:13.761472 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1007/2028] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:13.764641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fb34-a13f-4c18-9608-da26ca1e78f2 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:13.765000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fb34-a13f-4c18-9608-da26ca1e78f2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:13.765351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fb34-a13f-4c18-9608-da26ca1e78f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:13.773794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-161e89b5-45d9-45b5-8da9-6d0f55344eb5 None None] MFA Rules not processed for user `0f9b7af7120740499c8d42630a9e5a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:13.775267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-161e89b5-45d9-45b5-8da9-6d0f55344eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:13.786757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-cf59fb34-a13f-4c18-9608-da26ca1e78f2 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:13.788000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cf59fb34-a13f-4c18-9608-da26ca1e78f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:13.866157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:13.885876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1022/2029] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:13.893034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1008/2030] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:47:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:13.908912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e89b5-45d9-45b5-8da9-6d0f55344eb5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:13.910461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-161e89b5-45d9-45b5-8da9-6d0f55344eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:14.009421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e89b5-45d9-45b5-8da9-6d0f55344eb5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:14.015596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37194ada-ceec-4f6e-bcc9-922801899ac8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:14.016320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37194ada-ceec-4f6e-bcc9-922801899ac8 service swift] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:14.016650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37194ada-ceec-4f6e-bcc9-922801899ac8 service swift] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:14.016964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37194ada-ceec-4f6e-bcc9-922801899ac8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:14.029122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37194ada-ceec-4f6e-bcc9-922801899ac8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:14.031289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37194ada-ceec-4f6e-bcc9-922801899ac8 service swift] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:14.043925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1023/2031] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:47:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:47:14.049266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59fb34-a13f-4c18-9608-da26ca1e78f2 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:14.060061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59fb34-a13f-4c18-9608-da26ca1e78f2 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:14.064279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085db34a-7dac-4088-8b0e-c440f3b2d3a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:14.064971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085db34a-7dac-4088-8b0e-c440f3b2d3a9 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:14.065087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085db34a-7dac-4088-8b0e-c440f3b2d3a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:14.065346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085db34a-7dac-4088-8b0e-c440f3b2d3a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:14.075988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085db34a-7dac-4088-8b0e-c440f3b2d3a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:14.077546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085db34a-7dac-4088-8b0e-c440f3b2d3a9 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:14.101663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1009/2032] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:14.181502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37194ada-ceec-4f6e-bcc9-922801899ac8 service swift] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:14.201792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37194ada-ceec-4f6e-bcc9-922801899ac8 service swift] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:14.205690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab6fad-32d2-4d1c-ace8-fcdd43e8fbcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:14.206394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab6fad-32d2-4d1c-ace8-fcdd43e8fbcc service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:14.206685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab6fad-32d2-4d1c-ace8-fcdd43e8fbcc service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:14.206976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab6fad-32d2-4d1c-ace8-fcdd43e8fbcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:14.253907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:14.289420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab6fad-32d2-4d1c-ace8-fcdd43e8fbcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:14.292448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab6fad-32d2-4d1c-ace8-fcdd43e8fbcc service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:14.304259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1024/2033] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:14.770055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd66a94-ed03-45eb-9e99-c20d553f5c40 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:14.770533 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd66a94-ed03-45eb-9e99-c20d553f5c40 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:14.770626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd66a94-ed03-45eb-9e99-c20d553f5c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:14.791614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-dbd66a94-ed03-45eb-9e99-c20d553f5c40 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:14.792843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-dbd66a94-ed03-45eb-9e99-c20d553f5c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:14.800026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1010/2034] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 11:47:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:14.813599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab6fad-32d2-4d1c-ace8-fcdd43e8fbcc service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:14.827203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab6fad-32d2-4d1c-ace8-fcdd43e8fbcc service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:14.832316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff996-fa5c-47c3-896e-1770e57915b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:14.832925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff996-fa5c-47c3-896e-1770e57915b8 service swift] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:14.833211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff996-fa5c-47c3-896e-1770e57915b8 service swift] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:14.833490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff996-fa5c-47c3-896e-1770e57915b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:14.842590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff996-fa5c-47c3-896e-1770e57915b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:14.844332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff996-fa5c-47c3-896e-1770e57915b8 service swift] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:14.852993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1025/2035] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:47:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 11:47:15.114196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f4f7a-4c08-48f7-8b63-218ac7135e2e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:15.114483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f4f7a-4c08-48f7-8b63-218ac7135e2e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:15.114777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f4f7a-4c08-48f7-8b63-218ac7135e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:15.135310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-668f4f7a-4c08-48f7-8b63-218ac7135e2e None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:15.136518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-668f4f7a-4c08-48f7-8b63-218ac7135e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:15.143586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1011/2036] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:47:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:15.155763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff996-fa5c-47c3-896e-1770e57915b8 service swift] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:15.167055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff996-fa5c-47c3-896e-1770e57915b8 service swift] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:15.172015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142688f-5e53-49f8-bce7-191b87f824c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:15.172607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142688f-5e53-49f8-bce7-191b87f824c4 service swift] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:15.172890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142688f-5e53-49f8-bce7-191b87f824c4 service swift] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:15.173162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142688f-5e53-49f8-bce7-191b87f824c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:15.182342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142688f-5e53-49f8-bce7-191b87f824c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:15.183957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142688f-5e53-49f8-bce7-191b87f824c4 service swift] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:15.191909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1026/2037] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:47:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:47:15.592562 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f7897-1fdf-4573-a866-67ce20794595 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:15.592871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f7897-1fdf-4573-a866-67ce20794595 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:15.593206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f7897-1fdf-4573-a866-67ce20794595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:15.616678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-744f7897-1fdf-4573-a866-67ce20794595 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:15.618643 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-744f7897-1fdf-4573-a866-67ce20794595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:15.626939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1012/2038] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 11:47:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:15.641432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142688f-5e53-49f8-bce7-191b87f824c4 service swift] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:15.653643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142688f-5e53-49f8-bce7-191b87f824c4 service swift] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:15.659569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64779a00-0fc0-485b-b334-a8df7b0d1412 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:15.660267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64779a00-0fc0-485b-b334-a8df7b0d1412 service swift] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:15.660409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64779a00-0fc0-485b-b334-a8df7b0d1412 service swift] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:15.660682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64779a00-0fc0-485b-b334-a8df7b0d1412 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:15.671155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64779a00-0fc0-485b-b334-a8df7b0d1412 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:15.673207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64779a00-0fc0-485b-b334-a8df7b0d1412 service swift] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:15.695120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1027/2039] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:47:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:47:16.544354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f7897-1fdf-4573-a866-67ce20794595 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:16.611797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f7897-1fdf-4573-a866-67ce20794595 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:16.617009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:16.618372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:16.618879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:16.619180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] PATH_INFO: `/v3/users/2744b4fcf9e7457daf37cce547692381` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:16.620324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2744b4fcf9e7457daf37cce547692381)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:16.622396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:16.676262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2744b4fcf9e7457daf37cce547692381'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:16.684773 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2744b4fcf9e7457daf37cce547692381'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:16.685550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2744b4fcf9e7457daf37cce547692381'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:16.701029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2744b4fcf9e7457daf37cce547692381'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:16.701654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2744b4fcf9e7457daf37cce547692381'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:16.717418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1013/2040] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:16 2022] DELETE /identity/v3/users/2744b4fcf9e7457daf37cce547692381 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:16.723062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090d5ea-56bf-47ea-a372-e65060d7b7d8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:16.723592 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090d5ea-56bf-47ea-a372-e65060d7b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:16.723691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090d5ea-56bf-47ea-a372-e65060d7b7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:16.745804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-0090d5ea-56bf-47ea-a372-e65060d7b7d8 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:16.747070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0090d5ea-56bf-47ea-a372-e65060d7b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:16.813906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1028/2041] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:16.824206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:16.826006 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:16.881903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:16.901501 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f7857-70b0-4317-8912-590b9deb8ecf admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:16.905447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806f605-a276-43a7-9b2b-a5c412f88762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:16.906093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806f605-a276-43a7-9b2b-a5c412f88762 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:16.906379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806f605-a276-43a7-9b2b-a5c412f88762 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:16.906926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806f605-a276-43a7-9b2b-a5c412f88762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:16.919203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806f605-a276-43a7-9b2b-a5c412f88762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:16.920650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806f605-a276-43a7-9b2b-a5c412f88762 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:16.938475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1014/2042] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:17.007047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090d5ea-56bf-47ea-a372-e65060d7b7d8 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:17.007047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0090d5ea-56bf-47ea-a372-e65060d7b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:17.017746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090d5ea-56bf-47ea-a372-e65060d7b7d8 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:17.025466 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:17.026124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:17.026403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:17.026677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] PATH_INFO: `/v3/users/48565602421f416baa3e70519222ffa7` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:17.028162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48565602421f416baa3e70519222ffa7)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:17.030244 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:17.084965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48565602421f416baa3e70519222ffa7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.086400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48565602421f416baa3e70519222ffa7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.087521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48565602421f416baa3e70519222ffa7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.097741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48565602421f416baa3e70519222ffa7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.106816 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48565602421f416baa3e70519222ffa7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.137576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335b346-17d6-4dfd-8722-7cd59fbdbf37 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:17.138114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335b346-17d6-4dfd-8722-7cd59fbdbf37 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:17.138400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335b346-17d6-4dfd-8722-7cd59fbdbf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:17.138874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1029/2043] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:17 2022] DELETE /identity/v3/users/48565602421f416baa3e70519222ffa7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:17.159242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d335b346-17d6-4dfd-8722-7cd59fbdbf37 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:17.160482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d335b346-17d6-4dfd-8722-7cd59fbdbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:17.262002 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1015/2044] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:17.273428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:17.275748 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335b346-17d6-4dfd-8722-7cd59fbdbf37 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:17.277033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:17.280514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d335b346-17d6-4dfd-8722-7cd59fbdbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:17.288045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:17.299188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477e15f-1ad8-4fe9-a985-bf5eccd9ba2d admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:17.306180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:17.308051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:17.308948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:17.309292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] PATH_INFO: `/v3/projects/1ebfba5550a445bea63fc76202842244` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:17.311196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebfba5550a445bea63fc76202842244)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:17.313642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:17.360283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335b346-17d6-4dfd-8722-7cd59fbdbf37 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:17.378886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093af09-3201-447d-8ed2-f7586ef1fc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:17.379761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebfba5550a445bea63fc76202842244', 'request_id': 'req-7d2798cd-2a6b-46c1-9423-f4cff776efe6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.380203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093af09-3201-447d-8ed2-f7586ef1fc10 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:17.383017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093af09-3201-447d-8ed2-f7586ef1fc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:17.383411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093af09-3201-447d-8ed2-f7586ef1fc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:17.393016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093af09-3201-447d-8ed2-f7586ef1fc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:17.395018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093af09-3201-447d-8ed2-f7586ef1fc10 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:17.400107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebfba5550a445bea63fc76202842244', 'request_id': 'req-7d2798cd-2a6b-46c1-9423-f4cff776efe6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.407827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebfba5550a445bea63fc76202842244', 'request_id': 'req-7d2798cd-2a6b-46c1-9423-f4cff776efe6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.410353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1016/2045] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:17.424191 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] The token cache is being invalidate because project 1ebfba5550a445bea63fc76202842244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:17.425003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.425725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.427475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1030/2046] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:17 2022] DELETE /identity/v3/projects/1ebfba5550a445bea63fc76202842244 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:17.432143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093af09-3201-447d-8ed2-f7586ef1fc10 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:17.446638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093af09-3201-447d-8ed2-f7586ef1fc10 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:17.530811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:17.531465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:17.531739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:17.532009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] PATH_INFO: `/v3/users/b239f03c769c4cfba93fb702fb837541` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:17.533151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b239f03c769c4cfba93fb702fb837541)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:17.535160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:17.580961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:17.602439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b239f03c769c4cfba93fb702fb837541'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.618314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b239f03c769c4cfba93fb702fb837541'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.619129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b239f03c769c4cfba93fb702fb837541'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.636821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b239f03c769c4cfba93fb702fb837541'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.637587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b239f03c769c4cfba93fb702fb837541'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.655459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1017/2047] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:17 2022] DELETE /identity/v3/users/b239f03c769c4cfba93fb702fb837541 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:17.745511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:17.747594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:17.770680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2798cd-2a6b-46c1-9423-f4cff776efe6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:17.870898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:17.872363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:17.873144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:17.873607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] PATH_INFO: `/v3/projects/fda5d8095d0d43b39e55dbf283b0831b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:17.875705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda5d8095d0d43b39e55dbf283b0831b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:17.877776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:17.959412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda5d8095d0d43b39e55dbf283b0831b', 'request_id': 'req-e49a9d35-d9b2-4265-94cc-a80f32ddd204'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.968326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda5d8095d0d43b39e55dbf283b0831b', 'request_id': 'req-e49a9d35-d9b2-4265-94cc-a80f32ddd204'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:17.982224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda5d8095d0d43b39e55dbf283b0831b', 'request_id': 'req-e49a9d35-d9b2-4265-94cc-a80f32ddd204'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.002660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] The token cache is being invalidate because project fda5d8095d0d43b39e55dbf283b0831b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:18.003185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.003943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.009893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1031/2048] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:17 2022] DELETE /identity/v3/projects/fda5d8095d0d43b39e55dbf283b0831b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:18.011805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.014552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.014685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.014926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.039145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214f7a-33b8-47ff-ba49-c9137f14285e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.048604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:18.114939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a9d35-d9b2-4265-94cc-a80f32ddd204 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.120257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.120993 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.121130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.121280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.121557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] PATH_INFO: `/v3/users/dd40111600864c0f929955a8afb6b746` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.121695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.121978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.122284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] PATH_INFO: `/v3/projects/24152d0769a445d0b37562dddd4c1833` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.122841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd40111600864c0f929955a8afb6b746)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.123467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=24152d0769a445d0b37562dddd4c1833)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.124849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.125466 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.175716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd40111600864c0f929955a8afb6b746'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.178282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24152d0769a445d0b37562dddd4c1833', 'request_id': 'req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.182687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd40111600864c0f929955a8afb6b746'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.183396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd40111600864c0f929955a8afb6b746'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.185425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24152d0769a445d0b37562dddd4c1833', 'request_id': 'req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.191159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24152d0769a445d0b37562dddd4c1833', 'request_id': 'req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.196082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd40111600864c0f929955a8afb6b746'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.196884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd40111600864c0f929955a8afb6b746'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.205244 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] The token cache is being invalidate because project 24152d0769a445d0b37562dddd4c1833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:18.205553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.206214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.207768 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1032/2049] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:18 2022] DELETE /identity/v3/projects/24152d0769a445d0b37562dddd4c1833 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:18.208540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.213017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1018/2050] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:18 2022] DELETE /identity/v3/users/dd40111600864c0f929955a8afb6b746 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:18.213174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.213257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.214262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.246919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:18.291554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd249-bedc-47f3-aacc-6bf00ffc78ea admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.291889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9541f7-0106-435e-bdbb-479a90b1986a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.296937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.297744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.298031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.298313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] PATH_INFO: `/v3/users/eafc03d253f94a22b2b517cbcfc28fcb` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.299075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.299558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.299689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eafc03d253f94a22b2b517cbcfc28fcb)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.299879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.300519 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] PATH_INFO: `/v3/users/ae267b7f39244a1898109636e4691b19` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.301440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae267b7f39244a1898109636e4691b19)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.301627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.303934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.361306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eafc03d253f94a22b2b517cbcfc28fcb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.368784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae267b7f39244a1898109636e4691b19'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.369595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eafc03d253f94a22b2b517cbcfc28fcb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.369805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eafc03d253f94a22b2b517cbcfc28fcb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.370003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae267b7f39244a1898109636e4691b19'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.370949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae267b7f39244a1898109636e4691b19'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.372630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:18.384502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eafc03d253f94a22b2b517cbcfc28fcb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.385773 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0f6ce7e6-8994-4c08-9155-b576ce8f409f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eafc03d253f94a22b2b517cbcfc28fcb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.387489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae267b7f39244a1898109636e4691b19'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.399322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1267c2d3-819e-456d-82c3-e4f9ae9a6e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae267b7f39244a1898109636e4691b19'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.401608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1019/2051] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:18 2022] DELETE /identity/v3/users/eafc03d253f94a22b2b517cbcfc28fcb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:18.403133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d38fd1-e157-4e7b-87af-ef27e2023e96 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.403451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d38fd1-e157-4e7b-87af-ef27e2023e96 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.403843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d38fd1-e157-4e7b-87af-ef27e2023e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.426874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1033/2052] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:18 2022] DELETE /identity/v3/users/ae267b7f39244a1898109636e4691b19 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:18.428299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b7c2-1c42-43ad-9230-ff71d27d7f35 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.428650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b7c2-1c42-43ad-9230-ff71d27d7f35 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.429029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b7c2-1c42-43ad-9230-ff71d27d7f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.448011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-41d38fd1-e157-4e7b-87af-ef27e2023e96 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:18.449235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-41d38fd1-e157-4e7b-87af-ef27e2023e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.452430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b0b8b7c2-1c42-43ad-9230-ff71d27d7f35 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:18.453716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b0b8b7c2-1c42-43ad-9230-ff71d27d7f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.520342 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1020/2053] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:18.528300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cf6bf-770a-4551-ba94-0e543837a3c1 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.531778 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cf6bf-770a-4551-ba94-0e543837a3c1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.531911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1034/2054] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:18.532020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cf6bf-770a-4551-ba94-0e543837a3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.532098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6774e3-709f-4631-8f6c-af4469385ca0 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.532098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6774e3-709f-4631-8f6c-af4469385ca0 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.532098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6774e3-709f-4631-8f6c-af4469385ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.551670 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-0f6774e3-709f-4631-8f6c-af4469385ca0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:18.553288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0f6774e3-709f-4631-8f6c-af4469385ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.558414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-973cf6bf-770a-4551-ba94-0e543837a3c1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:18.559802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-973cf6bf-770a-4551-ba94-0e543837a3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.562801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1035/2055] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:18.563365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6774e3-709f-4631-8f6c-af4469385ca0 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.565115 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0f6774e3-709f-4631-8f6c-af4469385ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.572395 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1021/2056] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:18.573294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cf6bf-770a-4551-ba94-0e543837a3c1 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.585468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cf6bf-770a-4551-ba94-0e543837a3c1 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.596791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.597725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.598211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.598574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.600460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:18.601259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.603800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.622847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1022/2057] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:18.624421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.626336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.640375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6774e3-709f-4631-8f6c-af4469385ca0 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.647607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b233ff-1bb2-4286-998d-25863b4e314c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.648654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b233ff-1bb2-4286-998d-25863b4e314c service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.649113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b233ff-1bb2-4286-998d-25863b4e314c service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.649402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b233ff-1bb2-4286-998d-25863b4e314c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.661128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b233ff-1bb2-4286-998d-25863b4e314c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.662559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b233ff-1bb2-4286-998d-25863b4e314c service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.662657 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:18.677561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1036/2058] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:18.683863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b233ff-1bb2-4286-998d-25863b4e314c service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.701727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b233ff-1bb2-4286-998d-25863b4e314c service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.703399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7a64-88a9-494c-853e-9b71c014eb24 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.707282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6719f9-3bbc-4a82-afb0-793d62b50e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.707610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86097-d284-4bdc-b842-a6443816d089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.707999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6719f9-3bbc-4a82-afb0-793d62b50e1e admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.708289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6719f9-3bbc-4a82-afb0-793d62b50e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.708399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86097-d284-4bdc-b842-a6443816d089 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.708574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86097-d284-4bdc-b842-a6443816d089 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.708689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6719f9-3bbc-4a82-afb0-793d62b50e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.708846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86097-d284-4bdc-b842-a6443816d089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.709210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6719f9-3bbc-4a82-afb0-793d62b50e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.711864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6719f9-3bbc-4a82-afb0-793d62b50e1e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.719865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86097-d284-4bdc-b842-a6443816d089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.721303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86097-d284-4bdc-b842-a6443816d089 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.735265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1023/2059] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:18.736285 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86097-d284-4bdc-b842-a6443816d089 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.737791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fef86097-d284-4bdc-b842-a6443816d089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:18.745332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1037/2060] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:18 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:18.749479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6719f9-3bbc-4a82-afb0-793d62b50e1e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.752709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86097-d284-4bdc-b842-a6443816d089 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.804117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:18.825826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.826629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.827052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.827325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] PATH_INFO: `/v3/projects/67e0f19a725a436c9962bdb423071bc9` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.828480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e0f19a725a436c9962bdb423071bc9)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.830511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.837874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6719f9-3bbc-4a82-afb0-793d62b50e1e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.850194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177eed1e-d656-4961-8ca2-4d1bec95ac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:18.850843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177eed1e-d656-4961-8ca2-4d1bec95ac11 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:18.851649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177eed1e-d656-4961-8ca2-4d1bec95ac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:18.851935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177eed1e-d656-4961-8ca2-4d1bec95ac11 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:18.852717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177eed1e-d656-4961-8ca2-4d1bec95ac11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:18.854693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177eed1e-d656-4961-8ca2-4d1bec95ac11 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:18.884339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1038/2061] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:18 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:18.892122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177eed1e-d656-4961-8ca2-4d1bec95ac11 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.909696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177eed1e-d656-4961-8ca2-4d1bec95ac11 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:18.924380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e0f19a725a436c9962bdb423071bc9', 'request_id': 'req-0316e400-2397-459e-ba0b-66732e04322d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.935450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e0f19a725a436c9962bdb423071bc9', 'request_id': 'req-0316e400-2397-459e-ba0b-66732e04322d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.943564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e0f19a725a436c9962bdb423071bc9', 'request_id': 'req-0316e400-2397-459e-ba0b-66732e04322d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.958889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] The token cache is being invalidate because project 67e0f19a725a436c9962bdb423071bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:18.959267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.960154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:18.964001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1024/2062] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:18 2022] DELETE /identity/v3/projects/67e0f19a725a436c9962bdb423071bc9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:18.968271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:18.970550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.025252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f268060-2bb0-4de7-9a0b-68554a95c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.026072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268060-2bb0-4de7-9a0b-68554a95c979 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.027384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268060-2bb0-4de7-9a0b-68554a95c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.027691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268060-2bb0-4de7-9a0b-68554a95c979 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.028486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f268060-2bb0-4de7-9a0b-68554a95c979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.030706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f268060-2bb0-4de7-9a0b-68554a95c979 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.044047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1039/2063] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:19.044929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f268060-2bb0-4de7-9a0b-68554a95c979 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.046999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3f268060-2bb0-4de7-9a0b-68554a95c979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.060674 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f268060-2bb0-4de7-9a0b-68554a95c979 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.065751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.066385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.066667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.066968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] PATH_INFO: `/v3/projects/6bc74c9ed41f4bd4bb51397046af8552` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.068105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc74c9ed41f4bd4bb51397046af8552)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.069019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316e400-2397-459e-ba0b-66732e04322d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.070076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.073805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.074445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.074728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.075055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] PATH_INFO: `/v3/users/b9519cd7503240cda2e9c0a7c18b4da8` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.076229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9519cd7503240cda2e9c0a7c18b4da8)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.078165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.080087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:19.127685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc74c9ed41f4bd4bb51397046af8552', 'request_id': 'req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.131558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9519cd7503240cda2e9c0a7c18b4da8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.134899 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc74c9ed41f4bd4bb51397046af8552', 'request_id': 'req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.138755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9519cd7503240cda2e9c0a7c18b4da8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.139500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9519cd7503240cda2e9c0a7c18b4da8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.140440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc74c9ed41f4bd4bb51397046af8552', 'request_id': 'req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.152907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9519cd7503240cda2e9c0a7c18b4da8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.153599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9519cd7503240cda2e9c0a7c18b4da8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.155043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] The token cache is being invalidate because project 6bc74c9ed41f4bd4bb51397046af8552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:19.155316 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.155962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.157504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1040/2064] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:19 2022] DELETE /identity/v3/projects/6bc74c9ed41f4bd4bb51397046af8552 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:19.159699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.161435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.168960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1025/2065] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:18 2022] DELETE /identity/v3/users/b9519cd7503240cda2e9c0a7c18b4da8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:19.169838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.171218 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.224600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:19.250067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd4cc-ad11-40a2-b520-3ce71c8137fb admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.251240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab2ae4-b008-4326-861b-d792ae1da0ef admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.256961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.257152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a04431-c1cd-4f5e-a94c-9c791737a290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.258172 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.258543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.258647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a04431-c1cd-4f5e-a94c-9c791737a290 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.258725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a04431-c1cd-4f5e-a94c-9c791737a290 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.258831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] PATH_INFO: `/v3/projects/6fee2d4b94df489e80125bafe3dfe36a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.259071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a04431-c1cd-4f5e-a94c-9c791737a290 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.259702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a04431-c1cd-4f5e-a94c-9c791737a290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.259997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fee2d4b94df489e80125bafe3dfe36a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.261793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a04431-c1cd-4f5e-a94c-9c791737a290 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.261926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.273820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1041/2066] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:19.279482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697106b4-64a8-4049-8480-f23fd8c2d09b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.279921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697106b4-64a8-4049-8480-f23fd8c2d09b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.280350 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697106b4-64a8-4049-8480-f23fd8c2d09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.306721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-697106b4-64a8-4049-8480-f23fd8c2d09b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:19.307788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-697106b4-64a8-4049-8480-f23fd8c2d09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.321927 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fee2d4b94df489e80125bafe3dfe36a', 'request_id': 'req-7db090bb-9ec2-4033-8df8-c635f13299f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.337070 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fee2d4b94df489e80125bafe3dfe36a', 'request_id': 'req-7db090bb-9ec2-4033-8df8-c635f13299f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.345548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fee2d4b94df489e80125bafe3dfe36a', 'request_id': 'req-7db090bb-9ec2-4033-8df8-c635f13299f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.359561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] The token cache is being invalidate because project 6fee2d4b94df489e80125bafe3dfe36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:19.359958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.360723 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.362378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1026/2067] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:19 2022] DELETE /identity/v3/projects/6fee2d4b94df489e80125bafe3dfe36a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:19.366128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.369133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.379665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1042/2068] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:19.380564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697106b4-64a8-4049-8480-f23fd8c2d09b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.381868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-697106b4-64a8-4049-8480-f23fd8c2d09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.383814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:19.396110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697106b4-64a8-4049-8480-f23fd8c2d09b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.403257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.403257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.403527 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.403778 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] PATH_INFO: `/v3/users/0f9b7af7120740499c8d42630a9e5a2b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.404848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9b7af7120740499c8d42630a9e5a2b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.406793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.461956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db090bb-9ec2-4033-8df8-c635f13299f8 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.467316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97451bc7-3468-4659-ac08-ca752ffe97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.467643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9b7af7120740499c8d42630a9e5a2b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.468048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97451bc7-3468-4659-ac08-ca752ffe97c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.468277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97451bc7-3468-4659-ac08-ca752ffe97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.468385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9b7af7120740499c8d42630a9e5a2b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.468552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97451bc7-3468-4659-ac08-ca752ffe97c0 admin admin] PATH_INFO: `/v3/projects/942a44f3d29249aa95075f0a1c453afe/users/c80def75e7344846b3ee2d564e759c80/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.470572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9b7af7120740499c8d42630a9e5a2b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.485819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9b7af7120740499c8d42630a9e5a2b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.494635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9b135c3c-4a7c-4975-98b4-4115884b9aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9b7af7120740499c8d42630a9e5a2b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.500125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97451bc7-3468-4659-ac08-ca752ffe97c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942a44f3d29249aa95075f0a1c453afe, user_id=c80def75e7344846b3ee2d564e759c80, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.503846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97451bc7-3468-4659-ac08-ca752ffe97c0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.521707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1043/2069] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:19 2022] DELETE /identity/v3/users/0f9b7af7120740499c8d42630a9e5a2b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:19.525915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66055c-3ff9-4a77-91b6-9ae4df943338 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.526193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66055c-3ff9-4a77-91b6-9ae4df943338 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.526500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66055c-3ff9-4a77-91b6-9ae4df943338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.536485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1027/2070] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:19 2022] PUT /identity/v3/projects/942a44f3d29249aa95075f0a1c453afe/users/c80def75e7344846b3ee2d564e759c80/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:19.536485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97451bc7-3468-4659-ac08-ca752ffe97c0 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.538370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-97451bc7-3468-4659-ac08-ca752ffe97c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.547487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ec66055c-3ff9-4a77-91b6-9ae4df943338 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:19.548844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ec66055c-3ff9-4a77-91b6-9ae4df943338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.609663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:19.615686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97451bc7-3468-4659-ac08-ca752ffe97c0 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.621995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.622751 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.623074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.623464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] PATH_INFO: `/v3/projects/1389838541504f0fbba53a7f642b4983` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.624681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1389838541504f0fbba53a7f642b4983)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.626835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.628055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1044/2071] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:19.629547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceddb6-244c-4a36-b9ac-9afcb4c082b7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.629907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceddb6-244c-4a36-b9ac-9afcb4c082b7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.630213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceddb6-244c-4a36-b9ac-9afcb4c082b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.664760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-40ceddb6-244c-4a36-b9ac-9afcb4c082b7 None None] MFA Rules not processed for user `c80def75e7344846b3ee2d564e759c80`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:19.666120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-40ceddb6-244c-4a36-b9ac-9afcb4c082b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.717355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1389838541504f0fbba53a7f642b4983', 'request_id': 'req-29a2513d-94b2-490d-ab2a-800fac54b884'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.728573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1389838541504f0fbba53a7f642b4983', 'request_id': 'req-29a2513d-94b2-490d-ab2a-800fac54b884'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.735627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1389838541504f0fbba53a7f642b4983', 'request_id': 'req-29a2513d-94b2-490d-ab2a-800fac54b884'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.747931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] The token cache is being invalidate because project 1389838541504f0fbba53a7f642b4983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:19.748232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.749464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:19.751020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1028/2072] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:19 2022] DELETE /identity/v3/projects/1389838541504f0fbba53a7f642b4983 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:19.754294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1045/2073] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:19.756575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.757963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbcb1f-0843-4c0e-b66b-39c125a6923e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.758335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbcb1f-0843-4c0e-b66b-39c125a6923e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.759123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbcb1f-0843-4c0e-b66b-39c125a6923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.760750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.784984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ddbbcb1f-0843-4c0e-b66b-39c125a6923e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:19.786782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ddbbcb1f-0843-4c0e-b66b-39c125a6923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.790508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:19.840563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2513d-94b2-490d-ab2a-800fac54b884 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.845617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59193784-40a3-486b-b75c-946873255883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.846280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59193784-40a3-486b-b75c-946873255883 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.846567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59193784-40a3-486b-b75c-946873255883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.846882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59193784-40a3-486b-b75c-946873255883 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.847916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59193784-40a3-486b-b75c-946873255883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:19.847916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59193784-40a3-486b-b75c-946873255883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.849499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59193784-40a3-486b-b75c-946873255883 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.864953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1029/2074] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:19.870895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59193784-40a3-486b-b75c-946873255883 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.873716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-59193784-40a3-486b-b75c-946873255883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.874522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1046/2075] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:19.875782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbcb1f-0843-4c0e-b66b-39c125a6923e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.889976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbcb1f-0843-4c0e-b66b-39c125a6923e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.895211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee38107-b96f-4212-910d-84bb8f4924e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.895838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee38107-b96f-4212-910d-84bb8f4924e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.896124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee38107-b96f-4212-910d-84bb8f4924e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.896400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee38107-b96f-4212-910d-84bb8f4924e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.897036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee38107-b96f-4212-910d-84bb8f4924e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.900117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee38107-b96f-4212-910d-84bb8f4924e1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.901410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59193784-40a3-486b-b75c-946873255883 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:19.907163 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64c2c-b394-4501-a4e8-0ab3c7c4724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:19.907867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64c2c-b394-4501-a4e8-0ab3c7c4724f admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.908264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64c2c-b394-4501-a4e8-0ab3c7c4724f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.908784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64c2c-b394-4501-a4e8-0ab3c7c4724f admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.909544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64c2c-b394-4501-a4e8-0ab3c7c4724f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:19.911587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64c2c-b394-4501-a4e8-0ab3c7c4724f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:19.937936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1047/2076] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:19 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:19.939441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b97c1-e6e6-4ea5-be19-3570b4bef038 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:19.939785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b97c1-e6e6-4ea5-be19-3570b4bef038 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:19.939979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b97c1-e6e6-4ea5-be19-3570b4bef038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:19.957326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1030/2077] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:19 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:19.957326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64c2c-b394-4501-a4e8-0ab3c7c4724f admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:19.959115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5ce64c2c-b394-4501-a4e8-0ab3c7c4724f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:19.971347 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-911b97c1-e6e6-4ea5-be19-3570b4bef038 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:19.972571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-911b97c1-e6e6-4ea5-be19-3570b4bef038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:20.030280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64c2c-b394-4501-a4e8-0ab3c7c4724f admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.034937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.035568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.035870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.036429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] PATH_INFO: `/v3/projects/c06e6a1b01b94b2eaa08a637bb9aa97b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.036537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1048/2078] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:20.037056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b97c1-e6e6-4ea5-be19-3570b4bef038 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.040607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06e6a1b01b94b2eaa08a637bb9aa97b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.042860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.048083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b97c1-e6e6-4ea5-be19-3570b4bef038 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.052772 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d50164-c688-49dd-b215-d7d09c052645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.053380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d50164-c688-49dd-b215-d7d09c052645 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.053664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d50164-c688-49dd-b215-d7d09c052645 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.053941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d50164-c688-49dd-b215-d7d09c052645 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.055186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d50164-c688-49dd-b215-d7d09c052645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.057210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d50164-c688-49dd-b215-d7d09c052645 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.065295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:20.083184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1049/2079] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:20.083184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d50164-c688-49dd-b215-d7d09c052645 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.091838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06e6a1b01b94b2eaa08a637bb9aa97b', 'request_id': 'req-53a1186b-ba75-4b75-907a-dc21294bf291'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:20.093703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d50164-c688-49dd-b215-d7d09c052645 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.099619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06e6a1b01b94b2eaa08a637bb9aa97b', 'request_id': 'req-53a1186b-ba75-4b75-907a-dc21294bf291'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:20.106573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06e6a1b01b94b2eaa08a637bb9aa97b', 'request_id': 'req-53a1186b-ba75-4b75-907a-dc21294bf291'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:20.118061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] The token cache is being invalidate because project c06e6a1b01b94b2eaa08a637bb9aa97b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:20.118278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:20.119179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:20.120837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1031/2080] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:19 2022] DELETE /identity/v3/projects/c06e6a1b01b94b2eaa08a637bb9aa97b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:20.124356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.124356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:20.152236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:20.158681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5267c5-a4a1-400c-aab8-8416fd096098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.159409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5267c5-a4a1-400c-aab8-8416fd096098 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.159690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5267c5-a4a1-400c-aab8-8416fd096098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.160084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5267c5-a4a1-400c-aab8-8416fd096098 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.160684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5267c5-a4a1-400c-aab8-8416fd096098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.162623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5267c5-a4a1-400c-aab8-8416fd096098 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.185325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1050/2081] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:20.186361 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5267c5-a4a1-400c-aab8-8416fd096098 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.189202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-af5267c5-a4a1-400c-aab8-8416fd096098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:20.197400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1186b-ba75-4b75-907a-dc21294bf291 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.202031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5267c5-a4a1-400c-aab8-8416fd096098 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.202355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13417b-40cd-4fd0-a9a8-0d4ea29ca175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.203048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13417b-40cd-4fd0-a9a8-0d4ea29ca175 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.203330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13417b-40cd-4fd0-a9a8-0d4ea29ca175 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.203608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13417b-40cd-4fd0-a9a8-0d4ea29ca175 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.204257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13417b-40cd-4fd0-a9a8-0d4ea29ca175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:20.204561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13417b-40cd-4fd0-a9a8-0d4ea29ca175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.206205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13417b-40cd-4fd0-a9a8-0d4ea29ca175 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.206760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a502-75d1-4b02-89f6-f3c04928b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.207381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a502-75d1-4b02-89f6-f3c04928b96d admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.207665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a502-75d1-4b02-89f6-f3c04928b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.207937 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a502-75d1-4b02-89f6-f3c04928b96d admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.208576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3a502-75d1-4b02-89f6-f3c04928b96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.210151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3a502-75d1-4b02-89f6-f3c04928b96d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.222481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1032/2082] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:20.222481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3fb1-4b24-4671-b1ff-b1dad457e6c2 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.222481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3fb1-4b24-4671-b1ff-b1dad457e6c2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.222481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3fb1-4b24-4671-b1ff-b1dad457e6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.223360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1051/2083] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:20.223360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a502-75d1-4b02-89f6-f3c04928b96d admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.224556 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-70b3a502-75d1-4b02-89f6-f3c04928b96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:20.237420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a502-75d1-4b02-89f6-f3c04928b96d admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.242276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd3307-404f-4b47-9533-76a8378a1035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.242952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd3307-404f-4b47-9533-76a8378a1035 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.243238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd3307-404f-4b47-9533-76a8378a1035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.243511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd3307-404f-4b47-9533-76a8378a1035 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.244090 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c2aa3fb1-4b24-4671-b1ff-b1dad457e6c2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:20.244195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd3307-404f-4b47-9533-76a8378a1035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.245308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c2aa3fb1-4b24-4671-b1ff-b1dad457e6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:20.245736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd3307-404f-4b47-9533-76a8378a1035 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.253500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1033/2084] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:20.261027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3fb1-4b24-4671-b1ff-b1dad457e6c2 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.261136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1052/2085] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:20.261136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd3307-404f-4b47-9533-76a8378a1035 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.268414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3fb1-4b24-4671-b1ff-b1dad457e6c2 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.268590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd3307-404f-4b47-9533-76a8378a1035 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.273424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de819d62-73b5-47ee-a253-fd5fe3f0a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.273559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb7541-5e2d-41b8-a00b-9a068c07233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.274024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de819d62-73b5-47ee-a253-fd5fe3f0a2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.274308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de819d62-73b5-47ee-a253-fd5fe3f0a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.274432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7541-5e2d-41b8-a00b-9a068c07233d admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.274566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de819d62-73b5-47ee-a253-fd5fe3f0a2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.274658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7541-5e2d-41b8-a00b-9a068c07233d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.274872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7541-5e2d-41b8-a00b-9a068c07233d admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.275475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de819d62-73b5-47ee-a253-fd5fe3f0a2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.275729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7541-5e2d-41b8-a00b-9a068c07233d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.277181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de819d62-73b5-47ee-a253-fd5fe3f0a2c3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.278100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7541-5e2d-41b8-a00b-9a068c07233d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.288447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1053/2086] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:20.292350 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528943c6-8c04-4a5e-a6e5-07083332da8e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.292574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528943c6-8c04-4a5e-a6e5-07083332da8e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.292852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528943c6-8c04-4a5e-a6e5-07083332da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.311271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1034/2087] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:20.311271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb7541-5e2d-41b8-a00b-9a068c07233d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.313008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-528943c6-8c04-4a5e-a6e5-07083332da8e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:20.314226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-528943c6-8c04-4a5e-a6e5-07083332da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:20.379114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb7541-5e2d-41b8-a00b-9a068c07233d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.380479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1054/2088] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:20.381308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528943c6-8c04-4a5e-a6e5-07083332da8e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.384880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506f52d-4c1c-4958-b165-c6be3b08d3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.385573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506f52d-4c1c-4958-b165-c6be3b08d3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.385857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506f52d-4c1c-4958-b165-c6be3b08d3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.386128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506f52d-4c1c-4958-b165-c6be3b08d3ce admin admin] PATH_INFO: `/v3/projects/cdb6838154934177a7c689bbf0d18d22/users/ac1fc51cacf74f07bd8258d2a43e4a3c/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.391407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528943c6-8c04-4a5e-a6e5-07083332da8e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.396413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ea8a-1aa9-4f54-803e-0b0f26035a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.397072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ea8a-1aa9-4f54-803e-0b0f26035a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.397355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ea8a-1aa9-4f54-803e-0b0f26035a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.397636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ea8a-1aa9-4f54-803e-0b0f26035a70 admin admin] PATH_INFO: `/v3/projects/a9c97f12b1514f5e96e6c0cc8c3c577e/users/6f44f913c5b843018d5a984bd789f8b2/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.402611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506f52d-4c1c-4958-b165-c6be3b08d3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb6838154934177a7c689bbf0d18d22, user_id=ac1fc51cacf74f07bd8258d2a43e4a3c, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.405321 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506f52d-4c1c-4958-b165-c6be3b08d3ce admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.413952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3ea8a-1aa9-4f54-803e-0b0f26035a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c97f12b1514f5e96e6c0cc8c3c577e, user_id=6f44f913c5b843018d5a984bd789f8b2, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.416851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3ea8a-1aa9-4f54-803e-0b0f26035a70 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.419690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1035/2089] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:20 2022] PUT /identity/v3/projects/cdb6838154934177a7c689bbf0d18d22/users/ac1fc51cacf74f07bd8258d2a43e4a3c/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:20.420602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506f52d-4c1c-4958-b165-c6be3b08d3ce admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.432868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1055/2090] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:20 2022] PUT /identity/v3/projects/a9c97f12b1514f5e96e6c0cc8c3c577e/users/6f44f913c5b843018d5a984bd789f8b2/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:20.433716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ea8a-1aa9-4f54-803e-0b0f26035a70 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.460152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:20.496763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506f52d-4c1c-4958-b165-c6be3b08d3ce admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.500372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ea8a-1aa9-4f54-803e-0b0f26035a70 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.501567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a73d0d-1a76-479a-acd2-f188e0bab334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.502181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a73d0d-1a76-479a-acd2-f188e0bab334 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.502459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a73d0d-1a76-479a-acd2-f188e0bab334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.502736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a73d0d-1a76-479a-acd2-f188e0bab334 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.503390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a73d0d-1a76-479a-acd2-f188e0bab334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.505310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a73d0d-1a76-479a-acd2-f188e0bab334 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.505434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239a0bf-6885-4b5b-a0a1-1a13542cb9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.505933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239a0bf-6885-4b5b-a0a1-1a13542cb9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.506215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239a0bf-6885-4b5b-a0a1-1a13542cb9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.506485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239a0bf-6885-4b5b-a0a1-1a13542cb9e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.507165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239a0bf-6885-4b5b-a0a1-1a13542cb9e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:20.507771 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239a0bf-6885-4b5b-a0a1-1a13542cb9e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.509505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239a0bf-6885-4b5b-a0a1-1a13542cb9e6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.522399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1056/2091] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:20.527673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239a0bf-6885-4b5b-a0a1-1a13542cb9e6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.531180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1036/2092] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:20.532434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0215580-8c02-4a52-92c3-5987b5b04ace None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.532728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0215580-8c02-4a52-92c3-5987b5b04ace None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.533190 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0215580-8c02-4a52-92c3-5987b5b04ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.538209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239a0bf-6885-4b5b-a0a1-1a13542cb9e6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.541695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:20.543912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d4a7-bed2-4677-a82e-5f28a7863a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.544588 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d4a7-bed2-4677-a82e-5f28a7863a4e admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.544869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d4a7-bed2-4677-a82e-5f28a7863a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.545142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d4a7-bed2-4677-a82e-5f28a7863a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.545792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056d4a7-bed2-4677-a82e-5f28a7863a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.547644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056d4a7-bed2-4677-a82e-5f28a7863a4e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.557793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1057/2093] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:20.558587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d4a7-bed2-4677-a82e-5f28a7863a4e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.567398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f0215580-8c02-4a52-92c3-5987b5b04ace None None] MFA Rules not processed for user `6f44f913c5b843018d5a984bd789f8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:20.568622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f0215580-8c02-4a52-92c3-5987b5b04ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:20.570671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d4a7-bed2-4677-a82e-5f28a7863a4e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.575288 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab440d6-94a3-4751-9f55-640d19ee64b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.575876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab440d6-94a3-4751-9f55-640d19ee64b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.576151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab440d6-94a3-4751-9f55-640d19ee64b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.576418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab440d6-94a3-4751-9f55-640d19ee64b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.577036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab440d6-94a3-4751-9f55-640d19ee64b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.578957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab440d6-94a3-4751-9f55-640d19ee64b1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.607383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1058/2094] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:20.608607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab440d6-94a3-4751-9f55-640d19ee64b1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.639176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1037/2095] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:20.639176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0215580-8c02-4a52-92c3-5987b5b04ace None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.647398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0215580-8c02-4a52-92c3-5987b5b04ace None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.678355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab440d6-94a3-4751-9f55-640d19ee64b1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.684132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bcb01-f3e7-497b-b4b1-a9f9dd67c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.684783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bcb01-f3e7-497b-b4b1-a9f9dd67c0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.685066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bcb01-f3e7-497b-b4b1-a9f9dd67c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.685341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bcb01-f3e7-497b-b4b1-a9f9dd67c0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.685989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bcb01-f3e7-497b-b4b1-a9f9dd67c0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.687642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bcb01-f3e7-497b-b4b1-a9f9dd67c0f0 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.704903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1059/2096] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:20.704903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bcb01-f3e7-497b-b4b1-a9f9dd67c0f0 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.709541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37d7e4-b7d1-4c53-acde-a56606015e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.710220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d7e4-b7d1-4c53-acde-a56606015e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.710580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d7e4-b7d1-4c53-acde-a56606015e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.711133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37d7e4-b7d1-4c53-acde-a56606015e23 admin admin] PATH_INFO: `/v3/projects/cdb6838154934177a7c689bbf0d18d22/users/ac1fc51cacf74f07bd8258d2a43e4a3c/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.713202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37d7e4-b7d1-4c53-acde-a56606015e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb6838154934177a7c689bbf0d18d22, user_id=ac1fc51cacf74f07bd8258d2a43e4a3c, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.718429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37d7e4-b7d1-4c53-acde-a56606015e23 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.719042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bcb01-f3e7-497b-b4b1-a9f9dd67c0f0 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.725607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235cb4e-2088-46bc-bd80-5be156f489c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.726866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235cb4e-2088-46bc-bd80-5be156f489c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.727111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235cb4e-2088-46bc-bd80-5be156f489c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.727447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235cb4e-2088-46bc-bd80-5be156f489c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.728089 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235cb4e-2088-46bc-bd80-5be156f489c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.730052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235cb4e-2088-46bc-bd80-5be156f489c7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.742904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1038/2097] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:20 2022] PUT /identity/v3/projects/cdb6838154934177a7c689bbf0d18d22/users/ac1fc51cacf74f07bd8258d2a43e4a3c/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:20.742904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37d7e4-b7d1-4c53-acde-a56606015e23 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.742904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bc37d7e4-b7d1-4c53-acde-a56606015e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:20.755376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1060/2098] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:20.756262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235cb4e-2088-46bc-bd80-5be156f489c7 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.768573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235cb4e-2088-46bc-bd80-5be156f489c7 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.802155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37d7e4-b7d1-4c53-acde-a56606015e23 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.805883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a918ef5-2f59-4299-b413-613dca039e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.806485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a918ef5-2f59-4299-b413-613dca039e49 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.806793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a918ef5-2f59-4299-b413-613dca039e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.807059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a918ef5-2f59-4299-b413-613dca039e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.830444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6595a6-34e4-4054-83cc-697e11bc9707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.831090 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6595a6-34e4-4054-83cc-697e11bc9707 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.831376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6595a6-34e4-4054-83cc-697e11bc9707 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.831649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6595a6-34e4-4054-83cc-697e11bc9707 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.832295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6595a6-34e4-4054-83cc-697e11bc9707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.833956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6595a6-34e4-4054-83cc-697e11bc9707 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.836971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:20.847039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1061/2099] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:20.849008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:20.851420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b2162-7004-4792-b7d8-1f6ff2e679ad None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.851892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b2162-7004-4792-b7d8-1f6ff2e679ad None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.852177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b2162-7004-4792-b7d8-1f6ff2e679ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.867828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a918ef5-2f59-4299-b413-613dca039e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.869504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a918ef5-2f59-4299-b413-613dca039e49 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.879397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1039/2100] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:20.880228 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a918ef5-2f59-4299-b413-613dca039e49 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.892794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a918ef5-2f59-4299-b413-613dca039e49 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.893156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a67b2162-7004-4792-b7d8-1f6ff2e679ad None None] MFA Rules not processed for user `ac1fc51cacf74f07bd8258d2a43e4a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:20.894635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a67b2162-7004-4792-b7d8-1f6ff2e679ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:20.898873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bbee9-a85c-40bb-88aa-3869fe76ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.899494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bbee9-a85c-40bb-88aa-3869fe76ca15 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.899775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bbee9-a85c-40bb-88aa-3869fe76ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.900044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bbee9-a85c-40bb-88aa-3869fe76ca15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.900690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bbee9-a85c-40bb-88aa-3869fe76ca15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.902282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bbee9-a85c-40bb-88aa-3869fe76ca15 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.914216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1040/2101] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:20.915197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bbee9-a85c-40bb-88aa-3869fe76ca15 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:20.926880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bbee9-a85c-40bb-88aa-3869fe76ca15 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:20.944691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952c3e8-fd47-4357-9ab7-6bac7bc54cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:20.945414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952c3e8-fd47-4357-9ab7-6bac7bc54cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:20.945691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952c3e8-fd47-4357-9ab7-6bac7bc54cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:20.945962 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952c3e8-fd47-4357-9ab7-6bac7bc54cc7 admin admin] PATH_INFO: `/v3/projects/6a03ac049bc5477cbfcd27167cc0bf27/users/30892c83f0e0461c9232e9e082dcb6f7/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:20.965680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952c3e8-fd47-4357-9ab7-6bac7bc54cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a03ac049bc5477cbfcd27167cc0bf27, user_id=30892c83f0e0461c9232e9e082dcb6f7, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:20.968675 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952c3e8-fd47-4357-9ab7-6bac7bc54cc7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:20.988682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1041/2102] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:20 2022] PUT /identity/v3/projects/6a03ac049bc5477cbfcd27167cc0bf27/users/30892c83f0e0461c9232e9e082dcb6f7/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:21.000304 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952c3e8-fd47-4357-9ab7-6bac7bc54cc7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.000875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1062/2103] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:21.006833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ddc39-709d-49a9-99bc-6e0ed62d48d3 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.007733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ddc39-709d-49a9-99bc-6e0ed62d48d3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.008170 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ddc39-709d-49a9-99bc-6e0ed62d48d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.049844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-db4ddc39-709d-49a9-99bc-6e0ed62d48d3 None None] MFA Rules not processed for user `30892c83f0e0461c9232e9e082dcb6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:21.051133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-db4ddc39-709d-49a9-99bc-6e0ed62d48d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:21.129436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952c3e8-fd47-4357-9ab7-6bac7bc54cc7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.137071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ddad3-eb36-4c67-b4b1-4ceb7f774eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.137690 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ddad3-eb36-4c67-b4b1-4ceb7f774eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.137974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ddad3-eb36-4c67-b4b1-4ceb7f774eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.138249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ddad3-eb36-4c67-b4b1-4ceb7f774eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.138923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ddad3-eb36-4c67-b4b1-4ceb7f774eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.140603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ddad3-eb36-4c67-b4b1-4ceb7f774eb8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.152080 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1042/2104] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:21.153051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ddad3-eb36-4c67-b4b1-4ceb7f774eb8 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.155046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-112ddad3-eb36-4c67-b4b1-4ceb7f774eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:21.158284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1063/2105] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:21.159149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ddc39-709d-49a9-99bc-6e0ed62d48d3 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.171423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ddc39-709d-49a9-99bc-6e0ed62d48d3 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.179008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439eab7-212f-4494-9209-b4e6eb9365ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.179786 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439eab7-212f-4494-9209-b4e6eb9365ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.180064 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439eab7-212f-4494-9209-b4e6eb9365ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.180337 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439eab7-212f-4494-9209-b4e6eb9365ec admin admin] PATH_INFO: `/v3/projects/8dda3aa17bc24e4eb7a2130175e7061f/users/c821d0b6b8964c9a9013a4bb6e6617ca/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.201148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439eab7-212f-4494-9209-b4e6eb9365ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dda3aa17bc24e4eb7a2130175e7061f, user_id=c821d0b6b8964c9a9013a4bb6e6617ca, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.204482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439eab7-212f-4494-9209-b4e6eb9365ec admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.220222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1064/2106] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:21 2022] PUT /identity/v3/projects/8dda3aa17bc24e4eb7a2130175e7061f/users/c821d0b6b8964c9a9013a4bb6e6617ca/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:21.220222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439eab7-212f-4494-9209-b4e6eb9365ec admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.244721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ddad3-eb36-4c67-b4b1-4ceb7f774eb8 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.292121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:21.320267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439eab7-212f-4494-9209-b4e6eb9365ec admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.326752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904c9d1-03ee-4297-9107-9a5c2568ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.326752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c9d1-03ee-4297-9107-9a5c2568ad92 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.326752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c9d1-03ee-4297-9107-9a5c2568ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.326752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c9d1-03ee-4297-9107-9a5c2568ad92 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.327499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904c9d1-03ee-4297-9107-9a5c2568ad92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.327585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702f0c-b04b-4754-892e-c6c01ced0afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.327585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702f0c-b04b-4754-892e-c6c01ced0afa service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.327585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702f0c-b04b-4754-892e-c6c01ced0afa service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.327585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702f0c-b04b-4754-892e-c6c01ced0afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.327913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904c9d1-03ee-4297-9107-9a5c2568ad92 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.340120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:21.366492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1065/2107] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:21 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:21.368339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f68b6-eee1-4f39-8c50-3c2334ef4e03 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.369369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f68b6-eee1-4f39-8c50-3c2334ef4e03 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.369369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f68b6-eee1-4f39-8c50-3c2334ef4e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.398758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2702f0c-b04b-4754-892e-c6c01ced0afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.400151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2702f0c-b04b-4754-892e-c6c01ced0afa service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.400858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-780f68b6-eee1-4f39-8c50-3c2334ef4e03 None None] MFA Rules not processed for user `c821d0b6b8964c9a9013a4bb6e6617ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:21.402180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-780f68b6-eee1-4f39-8c50-3c2334ef4e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:21.410827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1043/2108] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:21 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:21.411611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702f0c-b04b-4754-892e-c6c01ced0afa service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.423092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702f0c-b04b-4754-892e-c6c01ced0afa service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.495835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1066/2109] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:21.496973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f68b6-eee1-4f39-8c50-3c2334ef4e03 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.498446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c5510-c03a-4f55-ad3d-300600526989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.499489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c5510-c03a-4f55-ad3d-300600526989 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.499775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c5510-c03a-4f55-ad3d-300600526989 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.500050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c5510-c03a-4f55-ad3d-300600526989 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.500673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c5510-c03a-4f55-ad3d-300600526989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.502583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c5510-c03a-4f55-ad3d-300600526989 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.508675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f68b6-eee1-4f39-8c50-3c2334ef4e03 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.513744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b369fe-4e1a-499b-971f-fabe37c91758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.514388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b369fe-4e1a-499b-971f-fabe37c91758 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.514683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b369fe-4e1a-499b-971f-fabe37c91758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.514990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b369fe-4e1a-499b-971f-fabe37c91758 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.515899 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b369fe-4e1a-499b-971f-fabe37c91758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.517986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b369fe-4e1a-499b-971f-fabe37c91758 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.538698 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1044/2110] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:21 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:21.539369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c5510-c03a-4f55-ad3d-300600526989 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.550262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c5510-c03a-4f55-ad3d-300600526989 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.554093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1067/2111] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:21 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:21.556181 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b369fe-4e1a-499b-971f-fabe37c91758 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.623081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e33575-dd75-4d31-856c-cb1e79a2f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.623696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e33575-dd75-4d31-856c-cb1e79a2f49e admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.624065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e33575-dd75-4d31-856c-cb1e79a2f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.624377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e33575-dd75-4d31-856c-cb1e79a2f49e admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.625264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e33575-dd75-4d31-856c-cb1e79a2f49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.627151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e33575-dd75-4d31-856c-cb1e79a2f49e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.629508 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b369fe-4e1a-499b-971f-fabe37c91758 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.636047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587a7e8-f87f-4c6a-afb7-b54142f41fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.636664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a7e8-f87f-4c6a-afb7-b54142f41fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.636939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a7e8-f87f-4c6a-afb7-b54142f41fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.637206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a7e8-f87f-4c6a-afb7-b54142f41fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.637840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587a7e8-f87f-4c6a-afb7-b54142f41fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.642374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1045/2112] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:21.642374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e33575-dd75-4d31-856c-cb1e79a2f49e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.642932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587a7e8-f87f-4c6a-afb7-b54142f41fd6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.652375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e33575-dd75-4d31-856c-cb1e79a2f49e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.657580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.658303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.658581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.658880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] PATH_INFO: `/v3/users/c80def75e7344846b3ee2d564e759c80` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.660669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80def75e7344846b3ee2d564e759c80)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.662580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.665093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1068/2113] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:21 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:21.665726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587a7e8-f87f-4c6a-afb7-b54142f41fd6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.676380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587a7e8-f87f-4c6a-afb7-b54142f41fd6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.681636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ce035-84cb-41b5-987b-5428e83372ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.682304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ce035-84cb-41b5-987b-5428e83372ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.682582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ce035-84cb-41b5-987b-5428e83372ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.682893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ce035-84cb-41b5-987b-5428e83372ba admin admin] PATH_INFO: `/v3/projects/143764b226ae4455a5b1ed5d5bfb2bd9/users/6c01576ab3ac4d47a8dda3adf6dd54b4/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.699694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ce035-84cb-41b5-987b-5428e83372ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=143764b226ae4455a5b1ed5d5bfb2bd9, user_id=6c01576ab3ac4d47a8dda3adf6dd54b4, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.700211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:21.702422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ce035-84cb-41b5-987b-5428e83372ba admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.717644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1069/2114] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:21 2022] PUT /identity/v3/projects/143764b226ae4455a5b1ed5d5bfb2bd9/users/6c01576ab3ac4d47a8dda3adf6dd54b4/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:21.720993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ce035-84cb-41b5-987b-5428e83372ba admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.723762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80def75e7344846b3ee2d564e759c80'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:21.727429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:21.732161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80def75e7344846b3ee2d564e759c80'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:21.732916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80def75e7344846b3ee2d564e759c80'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:21.747375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80def75e7344846b3ee2d564e759c80'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:21.748119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80def75e7344846b3ee2d564e759c80'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:21.762935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1046/2115] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:21 2022] DELETE /identity/v3/users/c80def75e7344846b3ee2d564e759c80 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:21.764043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.765446 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:21.785089 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ce035-84cb-41b5-987b-5428e83372ba admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.833556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac2f8f-9c31-4ea7-acb8-14c02065e0b8 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.838504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dba98-fc08-4505-9b82-9c148513e702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.839151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dba98-fc08-4505-9b82-9c148513e702 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.839435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dba98-fc08-4505-9b82-9c148513e702 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.839707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dba98-fc08-4505-9b82-9c148513e702 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.840353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dba98-fc08-4505-9b82-9c148513e702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.841976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dba98-fc08-4505-9b82-9c148513e702 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.844595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de397814-7e56-4db6-addd-f52970386a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.845236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de397814-7e56-4db6-addd-f52970386a55 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.845520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de397814-7e56-4db6-addd-f52970386a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.845825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de397814-7e56-4db6-addd-f52970386a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.846501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de397814-7e56-4db6-addd-f52970386a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.848210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de397814-7e56-4db6-addd-f52970386a55 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.852932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1047/2116] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:21.854177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f1d91-8a8a-4557-97fe-4a4d43abac8a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.854465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f1d91-8a8a-4557-97fe-4a4d43abac8a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.854740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f1d91-8a8a-4557-97fe-4a4d43abac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.860002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1070/2117] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:21.861134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de397814-7e56-4db6-addd-f52970386a55 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.872901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de397814-7e56-4db6-addd-f52970386a55 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.874672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-bd4f1d91-8a8a-4557-97fe-4a4d43abac8a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:21.875976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bd4f1d91-8a8a-4557-97fe-4a4d43abac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:21.878439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68513f7-3f4c-4854-b6a8-8051097f7388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.879133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68513f7-3f4c-4854-b6a8-8051097f7388 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.879416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68513f7-3f4c-4854-b6a8-8051097f7388 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.879691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68513f7-3f4c-4854-b6a8-8051097f7388 admin admin] PATH_INFO: `/v3/projects/143764b226ae4455a5b1ed5d5bfb2bd9/users/6c01576ab3ac4d47a8dda3adf6dd54b4/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.881611 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68513f7-3f4c-4854-b6a8-8051097f7388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143764b226ae4455a5b1ed5d5bfb2bd9, user_id=6c01576ab3ac4d47a8dda3adf6dd54b4, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.885045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1048/2118] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:21.885351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68513f7-3f4c-4854-b6a8-8051097f7388 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.885797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f1d91-8a8a-4557-97fe-4a4d43abac8a None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.887238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bd4f1d91-8a8a-4557-97fe-4a4d43abac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:21.900017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1071/2119] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:21 2022] PUT /identity/v3/projects/143764b226ae4455a5b1ed5d5bfb2bd9/users/6c01576ab3ac4d47a8dda3adf6dd54b4/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:21.900383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f1d91-8a8a-4557-97fe-4a4d43abac8a None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.900975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68513f7-3f4c-4854-b6a8-8051097f7388 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:21.907927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d68513f7-3f4c-4854-b6a8-8051097f7388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:21.965437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4f175-463f-45ef-954c-5c97c5fcd285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.966104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4f175-463f-45ef-954c-5c97c5fcd285 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.966411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4f175-463f-45ef-954c-5c97c5fcd285 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.966684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4f175-463f-45ef-954c-5c97c5fcd285 admin admin] PATH_INFO: `/v3/projects/69c9d67d3b964034afe34905f68ce032/users/b4b4ceeb917a4a539ce74b4467373307/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.975564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68513f7-3f4c-4854-b6a8-8051097f7388 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:21.979743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bd75b-72f0-48f5-9e6e-32c5be6670cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:21.980356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bd75b-72f0-48f5-9e6e-32c5be6670cd service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:21.980637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bd75b-72f0-48f5-9e6e-32c5be6670cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:21.980912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bd75b-72f0-48f5-9e6e-32c5be6670cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:21.981278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4f175-463f-45ef-954c-5c97c5fcd285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c9d67d3b964034afe34905f68ce032, user_id=b4b4ceeb917a4a539ce74b4467373307, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.984046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4f175-463f-45ef-954c-5c97c5fcd285 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.990838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bd75b-72f0-48f5-9e6e-32c5be6670cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:21.992719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bd75b-72f0-48f5-9e6e-32c5be6670cd service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:21.997715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1049/2120] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:21 2022] PUT /identity/v3/projects/69c9d67d3b964034afe34905f68ce032/users/b4b4ceeb917a4a539ce74b4467373307/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:22.001800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87997-7da8-43ae-ae70-d2310c731535 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.002091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87997-7da8-43ae-ae70-d2310c731535 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.002371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87997-7da8-43ae-ae70-d2310c731535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.002820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1072/2121] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:22.003699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bd75b-72f0-48f5-9e6e-32c5be6670cd service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:22.015302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bd75b-72f0-48f5-9e6e-32c5be6670cd service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:22.033883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-2ad87997-7da8-43ae-ae70-d2310c731535 None None] MFA Rules not processed for user `6c01576ab3ac4d47a8dda3adf6dd54b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:22.035164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2ad87997-7da8-43ae-ae70-d2310c731535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:22.041287 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:22.063495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:22.089194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbadbe9-886f-4cab-9383-f169d864c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:22.089921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbadbe9-886f-4cab-9383-f169d864c0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.090297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbadbe9-886f-4cab-9383-f169d864c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.090579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbadbe9-886f-4cab-9383-f169d864c0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.091409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbadbe9-886f-4cab-9383-f169d864c0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:22.093056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbadbe9-886f-4cab-9383-f169d864c0f4 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:22.104198 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1073/2122] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:22.108334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbadbe9-886f-4cab-9383-f169d864c0f4 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:22.121578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbadbe9-886f-4cab-9383-f169d864c0f4 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:22.127386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cba98-dc9a-4e36-a967-71417584498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:22.128122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cba98-dc9a-4e36-a967-71417584498f admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.128404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cba98-dc9a-4e36-a967-71417584498f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.128686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cba98-dc9a-4e36-a967-71417584498f admin admin] PATH_INFO: `/v3/projects/69c9d67d3b964034afe34905f68ce032/users/b4b4ceeb917a4a539ce74b4467373307/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.131326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cba98-dc9a-4e36-a967-71417584498f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c9d67d3b964034afe34905f68ce032, user_id=b4b4ceeb917a4a539ce74b4467373307, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:22.135176 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cba98-dc9a-4e36-a967-71417584498f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:22.143040 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1050/2123] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:22.149764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1074/2124] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:22 2022] PUT /identity/v3/projects/69c9d67d3b964034afe34905f68ce032/users/b4b4ceeb917a4a539ce74b4467373307/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:22.160741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cba98-dc9a-4e36-a967-71417584498f admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:22.161488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe530-d351-484a-b32c-896f9cc08d97 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.161781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe530-d351-484a-b32c-896f9cc08d97 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.162211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe530-d351-484a-b32c-896f9cc08d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.162711 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-be2cba98-dc9a-4e36-a967-71417584498f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:22.235132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cba98-dc9a-4e36-a967-71417584498f admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:22.239014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-a0abe530-d351-484a-b32c-896f9cc08d97 None None] MFA Rules not processed for user `b4b4ceeb917a4a539ce74b4467373307`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:22.239517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1a836-9277-4797-9d66-ff2fd4f73010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:22.240383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1a836-9277-4797-9d66-ff2fd4f73010 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.240912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1a836-9277-4797-9d66-ff2fd4f73010 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.241026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a0abe530-d351-484a-b32c-896f9cc08d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:22.241367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1a836-9277-4797-9d66-ff2fd4f73010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.347216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1a836-9277-4797-9d66-ff2fd4f73010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:22.349120 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1a836-9277-4797-9d66-ff2fd4f73010 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:22.362529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1075/2125] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:22.374883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1a836-9277-4797-9d66-ff2fd4f73010 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:22.378613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1051/2126] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:22.379253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-61d1a836-9277-4797-9d66-ff2fd4f73010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:22.412486 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe530-d351-484a-b32c-896f9cc08d97 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:22.414741 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a0abe530-d351-484a-b32c-896f9cc08d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:22.428673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe530-d351-484a-b32c-896f9cc08d97 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:22.433180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9afbff-2061-49a7-a303-7595b6d24c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:22.433796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9afbff-2061-49a7-a303-7595b6d24c62 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.434079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9afbff-2061-49a7-a303-7595b6d24c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.434404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9afbff-2061-49a7-a303-7595b6d24c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.447860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9afbff-2061-49a7-a303-7595b6d24c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:22.449305 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9afbff-2061-49a7-a303-7595b6d24c62 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:22.459857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1052/2127] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:22.490509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9afbff-2061-49a7-a303-7595b6d24c62 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:22.498861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1a836-9277-4797-9d66-ff2fd4f73010 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:22.506309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:22.506758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9afbff-2061-49a7-a303-7595b6d24c62 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:22.508446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.508810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.509461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] PATH_INFO: `/v3/projects/942a44f3d29249aa95075f0a1c453afe` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.511637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=942a44f3d29249aa95075f0a1c453afe)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:22.514435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:22.517891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:22.518580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.519467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.520240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] PATH_INFO: `/v3/users/c821d0b6b8964c9a9013a4bb6e6617ca` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.522104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c821d0b6b8964c9a9013a4bb6e6617ca)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:22.525846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:22.549735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:22.591089 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c821d0b6b8964c9a9013a4bb6e6617ca'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.600731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c821d0b6b8964c9a9013a4bb6e6617ca'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.601722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942a44f3d29249aa95075f0a1c453afe', 'request_id': 'req-a305d74e-93d6-4383-8cb2-b270e1e07f9b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.602132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c821d0b6b8964c9a9013a4bb6e6617ca'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.615261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:22.617248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942a44f3d29249aa95075f0a1c453afe', 'request_id': 'req-a305d74e-93d6-4383-8cb2-b270e1e07f9b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.624295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942a44f3d29249aa95075f0a1c453afe', 'request_id': 'req-a305d74e-93d6-4383-8cb2-b270e1e07f9b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.629276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c821d0b6b8964c9a9013a4bb6e6617ca'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.630622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b29889b5-b164-4bdb-aca6-63412de6ce2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c821d0b6b8964c9a9013a4bb6e6617ca'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.642580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] The token cache is being invalidate because project 942a44f3d29249aa95075f0a1c453afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:22.643304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.645201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.649037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1076/2128] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:22 2022] DELETE /identity/v3/projects/942a44f3d29249aa95075f0a1c453afe => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:22.653931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1053/2129] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:22 2022] DELETE /identity/v3/users/c821d0b6b8964c9a9013a4bb6e6617ca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:22.655422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:22.657014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:22.659435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b925-bcfb-4bf1-9f2e-3efba79e83ab None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.660637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b925-bcfb-4bf1-9f2e-3efba79e83ab None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.661192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b925-bcfb-4bf1-9f2e-3efba79e83ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.689490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f929b925-bcfb-4bf1-9f2e-3efba79e83ab None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:22.690933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f929b925-bcfb-4bf1-9f2e-3efba79e83ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:22.740866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d74e-93d6-4383-8cb2-b270e1e07f9b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:22.778931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1054/2130] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:22.790591 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929b925-bcfb-4bf1-9f2e-3efba79e83ab None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:22.793597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f929b925-bcfb-4bf1-9f2e-3efba79e83ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:22.816625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:22.817344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.817663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.818203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] PATH_INFO: `/v3/users/ac1fc51cacf74f07bd8258d2a43e4a3c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.819650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1fc51cacf74f07bd8258d2a43e4a3c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:22.822180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:22.878050 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1fc51cacf74f07bd8258d2a43e4a3c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.878885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1fc51cacf74f07bd8258d2a43e4a3c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.879582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1fc51cacf74f07bd8258d2a43e4a3c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.884945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929b925-bcfb-4bf1-9f2e-3efba79e83ab None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:22.887476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:22.889614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:22.890448 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:22.890841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:22.891374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:22.893247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:22.894319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1fc51cacf74f07bd8258d2a43e4a3c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.903535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1fc51cacf74f07bd8258d2a43e4a3c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:22.912451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:22.915491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:22.926327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1055/2131] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:22.928710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1077/2132] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:22 2022] DELETE /identity/v3/users/ac1fc51cacf74f07bd8258d2a43e4a3c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:23.173943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:23.175912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:23.190626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32521334-9fad-4e6a-93c1-79c86040b307 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:23.253465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:23.254370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.254720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.255031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] PATH_INFO: `/v3/users/30892c83f0e0461c9232e9e082dcb6f7` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.256180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30892c83f0e0461c9232e9e082dcb6f7)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:23.258463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:23.296306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:23.314394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30892c83f0e0461c9232e9e082dcb6f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.323073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30892c83f0e0461c9232e9e082dcb6f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.323839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30892c83f0e0461c9232e9e082dcb6f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.338015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:23.342760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:23.343014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30892c83f0e0461c9232e9e082dcb6f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.343967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30892c83f0e0461c9232e9e082dcb6f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.370998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1056/2133] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:23 2022] DELETE /identity/v3/users/30892c83f0e0461c9232e9e082dcb6f7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:23.370998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:23.372513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:23.400716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21c57e-2b3a-4b37-887a-05686b8803f9 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:23.459105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f13eb5-939d-4f4b-8b15-fb1752431814 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:23.465427 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:23.466397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.466706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.467029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] PATH_INFO: `/v3/projects/8dda3aa17bc24e4eb7a2130175e7061f` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.468345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dda3aa17bc24e4eb7a2130175e7061f)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:23.470464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:23.478913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:23.479648 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.480075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.480418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] PATH_INFO: `/v3/projects/cdb6838154934177a7c689bbf0d18d22` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.481623 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb6838154934177a7c689bbf0d18d22)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:23.483707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:23.531978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dda3aa17bc24e4eb7a2130175e7061f', 'request_id': 'req-9dddb39f-ef9a-4187-a54b-7303213395fd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.541247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dda3aa17bc24e4eb7a2130175e7061f', 'request_id': 'req-9dddb39f-ef9a-4187-a54b-7303213395fd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.541671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb6838154934177a7c689bbf0d18d22', 'request_id': 'req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.547260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dda3aa17bc24e4eb7a2130175e7061f', 'request_id': 'req-9dddb39f-ef9a-4187-a54b-7303213395fd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.548253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb6838154934177a7c689bbf0d18d22', 'request_id': 'req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.554976 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb6838154934177a7c689bbf0d18d22', 'request_id': 'req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.560050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] The token cache is being invalidate because project 8dda3aa17bc24e4eb7a2130175e7061f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:23.560387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.561135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9dddb39f-ef9a-4187-a54b-7303213395fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.563112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1057/2134] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:23 2022] DELETE /identity/v3/projects/8dda3aa17bc24e4eb7a2130175e7061f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:23.564250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534cc0-9700-451e-b40d-e82cc3697a7b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.564538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534cc0-9700-451e-b40d-e82cc3697a7b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.564804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534cc0-9700-451e-b40d-e82cc3697a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.569129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] The token cache is being invalidate because project cdb6838154934177a7c689bbf0d18d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:23.569423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.570905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.572414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1078/2135] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:23 2022] DELETE /identity/v3/projects/cdb6838154934177a7c689bbf0d18d22 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:23.575703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:23.575703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:23.585161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ce534cc0-9700-451e-b40d-e82cc3697a7b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:23.586474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ce534cc0-9700-451e-b40d-e82cc3697a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:23.621696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:23.640914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca4f8-c6e4-4024-9ec4-59e7f43dc58c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:23.645902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:23.646525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.646916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.647095 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] PATH_INFO: `/v3/users/b4b4ceeb917a4a539ce74b4467373307` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.648495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b4ceeb917a4a539ce74b4467373307)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:23.650411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:23.651977 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:23.652491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1058/2136] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:23.653719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6511-8c29-43d3-ac50-1edbeb74304f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.653899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6511-8c29-43d3-ac50-1edbeb74304f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.654304 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6511-8c29-43d3-ac50-1edbeb74304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.676499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-41ce6511-8c29-43d3-ac50-1edbeb74304f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:23.677733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-41ce6511-8c29-43d3-ac50-1edbeb74304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:23.688119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1059/2137] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:23.689149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce6511-8c29-43d3-ac50-1edbeb74304f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:23.692509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-41ce6511-8c29-43d3-ac50-1edbeb74304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:23.712872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b4ceeb917a4a539ce74b4467373307'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.713805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b4ceeb917a4a539ce74b4467373307'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.714981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b4ceeb917a4a539ce74b4467373307'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.723557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b4ceeb917a4a539ce74b4467373307'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.732045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4237e24-1acb-41fe-8a78-230321daa928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b4ceeb917a4a539ce74b4467373307'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:23.754127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1079/2138] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:23 2022] DELETE /identity/v3/users/b4b4ceeb917a4a539ce74b4467373307 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:23.755831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb25484-57e7-40c2-a30a-fbcaf0394e7f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.756125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb25484-57e7-40c2-a30a-fbcaf0394e7f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.756406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb25484-57e7-40c2-a30a-fbcaf0394e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.775393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce6511-8c29-43d3-ac50-1edbeb74304f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:23.782366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-dfb25484-57e7-40c2-a30a-fbcaf0394e7f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:23.783661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dfb25484-57e7-40c2-a30a-fbcaf0394e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:23.858724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befaa48-b362-448c-9c5e-8ac29e058639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:23.860020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befaa48-b362-448c-9c5e-8ac29e058639 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.860440 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befaa48-b362-448c-9c5e-8ac29e058639 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.860807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befaa48-b362-448c-9c5e-8ac29e058639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.864540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1080/2139] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:23.865009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5befaa48-b362-448c-9c5e-8ac29e058639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:23.866319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb25484-57e7-40c2-a30a-fbcaf0394e7f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:23.880223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befaa48-b362-448c-9c5e-8ac29e058639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:23.880560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb25484-57e7-40c2-a30a-fbcaf0394e7f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:23.882954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befaa48-b362-448c-9c5e-8ac29e058639 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:23.887071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2666b-796c-48ae-b642-9f0de4b6fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:23.888882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2666b-796c-48ae-b642-9f0de4b6fc0d admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.889177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2666b-796c-48ae-b642-9f0de4b6fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.889452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2666b-796c-48ae-b642-9f0de4b6fc0d admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.890381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2666b-796c-48ae-b642-9f0de4b6fc0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:23.891234 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2666b-796c-48ae-b642-9f0de4b6fc0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:23.893042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2666b-796c-48ae-b642-9f0de4b6fc0d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:23.909051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1081/2140] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:47:23.916259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1060/2141] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:23.917277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2666b-796c-48ae-b642-9f0de4b6fc0d admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:23.933970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2666b-796c-48ae-b642-9f0de4b6fc0d admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:23.939443 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf1ad4-3820-44dc-b14d-231a43087702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:23.940262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf1ad4-3820-44dc-b14d-231a43087702 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:23.940397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf1ad4-3820-44dc-b14d-231a43087702 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:23.940642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf1ad4-3820-44dc-b14d-231a43087702 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:23.941770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf1ad4-3820-44dc-b14d-231a43087702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:23.943843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf1ad4-3820-44dc-b14d-231a43087702 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:23.977982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1082/2142] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:23 2022] POST /identity/v3/projects => generated 409 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:23.982061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befaa48-b362-448c-9c5e-8ac29e058639 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:23.993778 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befaa48-b362-448c-9c5e-8ac29e058639 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.072686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3ec3-7209-450c-a0aa-4dfd48027a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.074714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3ec3-7209-450c-a0aa-4dfd48027a82 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.075132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3ec3-7209-450c-a0aa-4dfd48027a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.075508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3ec3-7209-450c-a0aa-4dfd48027a82 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.076244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc3ec3-7209-450c-a0aa-4dfd48027a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.078291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc3ec3-7209-450c-a0aa-4dfd48027a82 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.108865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1061/2143] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:23 2022] POST /identity/v3/users => generated 305 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:24.110299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf1ad4-3820-44dc-b14d-231a43087702 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.122409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf1ad4-3820-44dc-b14d-231a43087702 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.131882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3ec3-7209-450c-a0aa-4dfd48027a82 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.133332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c83c6-37e5-4838-ac1a-7c4e0a63bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.134409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c83c6-37e5-4838-ac1a-7c4e0a63bb4e admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.134706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c83c6-37e5-4838-ac1a-7c4e0a63bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.135038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c83c6-37e5-4838-ac1a-7c4e0a63bb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.135275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1fdc3ec3-7209-450c-a0aa-4dfd48027a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.135872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c83c6-37e5-4838-ac1a-7c4e0a63bb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.138220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c83c6-37e5-4838-ac1a-7c4e0a63bb4e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.153721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1083/2144] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:24.154561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3ec3-7209-450c-a0aa-4dfd48027a82 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.159121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c83c6-37e5-4838-ac1a-7c4e0a63bb4e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.169152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.170078 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.170229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.170502 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] PATH_INFO: `/v3/projects/69c9d67d3b964034afe34905f68ce032` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.172816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c9d67d3b964034afe34905f68ce032)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.176437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.180964 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c83c6-37e5-4838-ac1a-7c4e0a63bb4e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.186646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb3c2b-4ef6-4ebe-9039-13730966bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.187375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb3c2b-4ef6-4ebe-9039-13730966bda4 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.187732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb3c2b-4ef6-4ebe-9039-13730966bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.188011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb3c2b-4ef6-4ebe-9039-13730966bda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.188751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb3c2b-4ef6-4ebe-9039-13730966bda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.190509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb3c2b-4ef6-4ebe-9039-13730966bda4 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.202665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:24.206015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1084/2145] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:47:24.206968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb3c2b-4ef6-4ebe-9039-13730966bda4 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.219907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb3c2b-4ef6-4ebe-9039-13730966bda4 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.226538 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f780c1-85f5-4af3-b661-29f401d91bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.227699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f780c1-85f5-4af3-b661-29f401d91bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.228022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f780c1-85f5-4af3-b661-29f401d91bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.228306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f780c1-85f5-4af3-b661-29f401d91bb4 admin admin] PATH_INFO: `/v3/projects/735da6582cd24f299ffc0e9523728560/users/ece7040f8ae648728cd40ce098135fc3/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.245851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c9d67d3b964034afe34905f68ce032', 'request_id': 'req-85078b4f-c806-4c5f-acd4-45cf1975669e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.246505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f780c1-85f5-4af3-b661-29f401d91bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735da6582cd24f299ffc0e9523728560, user_id=ece7040f8ae648728cd40ce098135fc3, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.249501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f780c1-85f5-4af3-b661-29f401d91bb4 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.255876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c9d67d3b964034afe34905f68ce032', 'request_id': 'req-85078b4f-c806-4c5f-acd4-45cf1975669e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.261272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:24.266169 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c9d67d3b964034afe34905f68ce032', 'request_id': 'req-85078b4f-c806-4c5f-acd4-45cf1975669e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.268349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1085/2146] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:24 2022] PUT /identity/v3/projects/735da6582cd24f299ffc0e9523728560/users/ece7040f8ae648728cd40ce098135fc3/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:24.280804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a02dc-0529-4cf3-8c65-966d033b89ff None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.281280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a02dc-0529-4cf3-8c65-966d033b89ff None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.281662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a02dc-0529-4cf3-8c65-966d033b89ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.290490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] The token cache is being invalidate because project 69c9d67d3b964034afe34905f68ce032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:24.291150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.292185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.294666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1062/2147] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:24 2022] DELETE /identity/v3/projects/69c9d67d3b964034afe34905f68ce032 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:24.295579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.300325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.320636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a50a02dc-0529-4cf3-8c65-966d033b89ff None None] MFA Rules not processed for user `ece7040f8ae648728cd40ce098135fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:24.322802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a50a02dc-0529-4cf3-8c65-966d033b89ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.369545 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078b4f-c806-4c5f-acd4-45cf1975669e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.396070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1086/2148] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:24 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:24.403209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097993-9e10-45c4-b416-643d53aca269 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.403644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097993-9e10-45c4-b416-643d53aca269 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.404061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097993-9e10-45c4-b416-643d53aca269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.429852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ae097993-9e10-45c4-b416-643d53aca269 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:24.431679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ae097993-9e10-45c4-b416-643d53aca269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.432795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.433450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.433726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.433999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] PATH_INFO: `/v3/projects/6a03ac049bc5477cbfcd27167cc0bf27` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.435185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a03ac049bc5477cbfcd27167cc0bf27)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.437082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.441407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1087/2149] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:24.442114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae097993-9e10-45c4-b416-643d53aca269 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.443902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ae097993-9e10-45c4-b416-643d53aca269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.458220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae097993-9e10-45c4-b416-643d53aca269 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.463552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db6324-3857-43e9-b5a1-a4e7e9cda387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.464162 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db6324-3857-43e9-b5a1-a4e7e9cda387 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.464442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db6324-3857-43e9-b5a1-a4e7e9cda387 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.464718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db6324-3857-43e9-b5a1-a4e7e9cda387 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.465341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db6324-3857-43e9-b5a1-a4e7e9cda387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.467734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db6324-3857-43e9-b5a1-a4e7e9cda387 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.486322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a03ac049bc5477cbfcd27167cc0bf27', 'request_id': 'req-05d4e136-af70-403e-86e3-bcb824479e1a'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.490495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:24.495766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a03ac049bc5477cbfcd27167cc0bf27', 'request_id': 'req-05d4e136-af70-403e-86e3-bcb824479e1a'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.497555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1088/2150] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:24 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:24.498601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9630f-a596-4684-8aa1-f31fd092d23d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.498935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9630f-a596-4684-8aa1-f31fd092d23d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.499209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9630f-a596-4684-8aa1-f31fd092d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.508134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a03ac049bc5477cbfcd27167cc0bf27', 'request_id': 'req-05d4e136-af70-403e-86e3-bcb824479e1a'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.519815 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] The token cache is being invalidate because project 6a03ac049bc5477cbfcd27167cc0bf27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:24.520108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.520904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.521781 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-e6b9630f-a596-4684-8aa1-f31fd092d23d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:24.522440 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1063/2151] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:24 2022] DELETE /identity/v3/projects/6a03ac049bc5477cbfcd27167cc0bf27 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:24.523129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e6b9630f-a596-4684-8aa1-f31fd092d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.523907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.526453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.597014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e136-af70-403e-86e3-bcb824479e1a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.603509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1089/2152] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:24.603509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9630f-a596-4684-8aa1-f31fd092d23d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.603509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e6b9630f-a596-4684-8aa1-f31fd092d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.605851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6ed7f-6c62-4a59-9364-4fab374da35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.606560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6ed7f-6c62-4a59-9364-4fab374da35e admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.606952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6ed7f-6c62-4a59-9364-4fab374da35e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.607303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6ed7f-6c62-4a59-9364-4fab374da35e admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.608014 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6ed7f-6c62-4a59-9364-4fab374da35e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.610116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6ed7f-6c62-4a59-9364-4fab374da35e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.615395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9630f-a596-4684-8aa1-f31fd092d23d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.620187 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.620812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.621091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.621358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] PATH_INFO: `/v3/users/6c01576ab3ac4d47a8dda3adf6dd54b4` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.622521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c01576ab3ac4d47a8dda3adf6dd54b4)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.624478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.639154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1064/2153] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:24 2022] POST /identity/v3/users => generated 311 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:24.643428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6ed7f-6c62-4a59-9364-4fab374da35e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.657053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6ed7f-6c62-4a59-9364-4fab374da35e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.664441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa48c6-bf7e-4bc6-b922-39d7e47888be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.665120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa48c6-bf7e-4bc6-b922-39d7e47888be admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.665339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa48c6-bf7e-4bc6-b922-39d7e47888be admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.666598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa48c6-bf7e-4bc6-b922-39d7e47888be admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.667497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa48c6-bf7e-4bc6-b922-39d7e47888be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:24.668372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa48c6-bf7e-4bc6-b922-39d7e47888be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.670489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa48c6-bf7e-4bc6-b922-39d7e47888be admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.688270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1065/2154] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:24.688270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa48c6-bf7e-4bc6-b922-39d7e47888be admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.696183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c01576ab3ac4d47a8dda3adf6dd54b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.697041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c01576ab3ac4d47a8dda3adf6dd54b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.697426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa48c6-bf7e-4bc6-b922-39d7e47888be admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.697741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c01576ab3ac4d47a8dda3adf6dd54b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.702283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d582b-0cdf-4ef0-95d3-7854fc1a1847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.703021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d582b-0cdf-4ef0-95d3-7854fc1a1847 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.703378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d582b-0cdf-4ef0-95d3-7854fc1a1847 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.703868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d582b-0cdf-4ef0-95d3-7854fc1a1847 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.704530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d582b-0cdf-4ef0-95d3-7854fc1a1847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.705704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:24.706125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d582b-0cdf-4ef0-95d3-7854fc1a1847 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.707072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c01576ab3ac4d47a8dda3adf6dd54b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.719332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c01576ab3ac4d47a8dda3adf6dd54b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:24.723460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1066/2155] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:24.723460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d582b-0cdf-4ef0-95d3-7854fc1a1847 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.723460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-dc0d582b-0cdf-4ef0-95d3-7854fc1a1847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.737249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d582b-0cdf-4ef0-95d3-7854fc1a1847 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.743705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd269f-b2a9-4ad5-a9bb-239065286412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.744702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd269f-b2a9-4ad5-a9bb-239065286412 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.744992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd269f-b2a9-4ad5-a9bb-239065286412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.745260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd269f-b2a9-4ad5-a9bb-239065286412 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.745886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd269f-b2a9-4ad5-a9bb-239065286412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.747997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd269f-b2a9-4ad5-a9bb-239065286412 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.748127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1090/2156] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:24 2022] DELETE /identity/v3/users/6c01576ab3ac4d47a8dda3adf6dd54b4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:24.748873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.750243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:24.791970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1067/2157] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:24 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:24.796271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd269f-b2a9-4ad5-a9bb-239065286412 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.833765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543c894-84f8-4fd0-ae65-91969732406c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.875359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd269f-b2a9-4ad5-a9bb-239065286412 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.881498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1788f-4a80-4b7e-b72f-0d6599c1ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.882270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1788f-4a80-4b7e-b72f-0d6599c1ab2a admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.882662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1788f-4a80-4b7e-b72f-0d6599c1ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.883032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1788f-4a80-4b7e-b72f-0d6599c1ab2a admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.883782 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1788f-4a80-4b7e-b72f-0d6599c1ab2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.886175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1788f-4a80-4b7e-b72f-0d6599c1ab2a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.903122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e42184-adb9-413f-9eb2-62ea5477f794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.903819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e42184-adb9-413f-9eb2-62ea5477f794 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.904163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e42184-adb9-413f-9eb2-62ea5477f794 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.904371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e42184-adb9-413f-9eb2-62ea5477f794 admin admin] PATH_INFO: `/v3/projects/59825ba04ce347928c945d6eb1236b1b/users/2ad13a7d17ca46c7ae53d03fc2692f6e/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.915646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1068/2158] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:24 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:47:24.916946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1788f-4a80-4b7e-b72f-0d6599c1ab2a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.933783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1788f-4a80-4b7e-b72f-0d6599c1ab2a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:24.940323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3ca18-8e9e-4eb0-afa1-ac38776c2316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:24.941023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e42184-adb9-413f-9eb2-62ea5477f794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59825ba04ce347928c945d6eb1236b1b, user_id=2ad13a7d17ca46c7ae53d03fc2692f6e, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.941669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3ca18-8e9e-4eb0-afa1-ac38776c2316 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:24.942007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3ca18-8e9e-4eb0-afa1-ac38776c2316 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:24.942328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3ca18-8e9e-4eb0-afa1-ac38776c2316 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:24.943370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3ca18-8e9e-4eb0-afa1-ac38776c2316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:24.944560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e42184-adb9-413f-9eb2-62ea5477f794 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.946302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3ca18-8e9e-4eb0-afa1-ac38776c2316 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:24.961717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1091/2160] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:24 2022] PUT /identity/v3/projects/59825ba04ce347928c945d6eb1236b1b/users/2ad13a7d17ca46c7ae53d03fc2692f6e/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:24.961928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1069/2160] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:24.966752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3ca18-8e9e-4eb0-afa1-ac38776c2316 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.967963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e42184-adb9-413f-9eb2-62ea5477f794 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:24.972044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=91,keystone:DELETE=2,keystone:INSERT=7 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:24.981583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3ca18-8e9e-4eb0-afa1-ac38776c2316 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.063421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedca2bb-54e7-4b83-9a4d-2a3a9417fd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.064540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca2bb-54e7-4b83-9a4d-2a3a9417fd8d admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.064830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca2bb-54e7-4b83-9a4d-2a3a9417fd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.065108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca2bb-54e7-4b83-9a4d-2a3a9417fd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.065920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedca2bb-54e7-4b83-9a4d-2a3a9417fd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.067683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedca2bb-54e7-4b83-9a4d-2a3a9417fd8d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.073894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e42184-adb9-413f-9eb2-62ea5477f794 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.081396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1070/2161] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:25.082357 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158c32b-31e0-4893-b747-e9260682da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.083187 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158c32b-31e0-4893-b747-e9260682da25 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.083537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158c32b-31e0-4893-b747-e9260682da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.083823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158c32b-31e0-4893-b747-e9260682da25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.084580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158c32b-31e0-4893-b747-e9260682da25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.086549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedca2bb-54e7-4b83-9a4d-2a3a9417fd8d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.087530 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158c32b-31e0-4893-b747-e9260682da25 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.090555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:25.098029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedca2bb-54e7-4b83-9a4d-2a3a9417fd8d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.103922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4096b-9de6-4ebb-8ddb-d845cc68b334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.104565 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4096b-9de6-4ebb-8ddb-d845cc68b334 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.104846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4096b-9de6-4ebb-8ddb-d845cc68b334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.105117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4096b-9de6-4ebb-8ddb-d845cc68b334 admin admin] PATH_INFO: `/v3/projects/83109f1b2e8340e2a5c2f31ec89c7875/users/956dbcbb35a1474396078df53132bc44/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.113860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1092/2162] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:25.115877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158c32b-31e0-4893-b747-e9260682da25 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.120624 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7158c32b-31e0-4893-b747-e9260682da25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:25.130485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4096b-9de6-4ebb-8ddb-d845cc68b334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83109f1b2e8340e2a5c2f31ec89c7875, user_id=956dbcbb35a1474396078df53132bc44, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.135437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4096b-9de6-4ebb-8ddb-d845cc68b334 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.148732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158c32b-31e0-4893-b747-e9260682da25 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.159712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1071/2163] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:25 2022] PUT /identity/v3/projects/83109f1b2e8340e2a5c2f31ec89c7875/users/956dbcbb35a1474396078df53132bc44/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:25.169576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4096b-9de6-4ebb-8ddb-d845cc68b334 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.248226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.248918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.249633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.249777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] PATH_INFO: `/v3/projects/143764b226ae4455a5b1ed5d5bfb2bd9` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.251497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143764b226ae4455a5b1ed5d5bfb2bd9)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.254729 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.260308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4096b-9de6-4ebb-8ddb-d845cc68b334 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.265192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcabea2-e6a0-4b60-acb4-65d109885213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.265915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcabea2-e6a0-4b60-acb4-65d109885213 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.266192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcabea2-e6a0-4b60-acb4-65d109885213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.266462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcabea2-e6a0-4b60-acb4-65d109885213 admin admin] PATH_INFO: `/v3/projects/59825ba04ce347928c945d6eb1236b1b/users/2ad13a7d17ca46c7ae53d03fc2692f6e/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.268559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcabea2-e6a0-4b60-acb4-65d109885213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59825ba04ce347928c945d6eb1236b1b, user_id=2ad13a7d17ca46c7ae53d03fc2692f6e, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.271492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcabea2-e6a0-4b60-acb4-65d109885213 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.283969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1072/2164] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:25 2022] PUT /identity/v3/projects/59825ba04ce347928c945d6eb1236b1b/users/2ad13a7d17ca46c7ae53d03fc2692f6e/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:25.285392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315943a9-c639-4285-849b-f367c221597a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.285552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315943a9-c639-4285-849b-f367c221597a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.285823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315943a9-c639-4285-849b-f367c221597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.314904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143764b226ae4455a5b1ed5d5bfb2bd9', 'request_id': 'req-70472226-d3f5-4f71-bd28-caf64c8620a9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:25.315367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-315943a9-c639-4285-849b-f367c221597a None None] MFA Rules not processed for user `956dbcbb35a1474396078df53132bc44`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:25.316634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-315943a9-c639-4285-849b-f367c221597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:25.321874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143764b226ae4455a5b1ed5d5bfb2bd9', 'request_id': 'req-70472226-d3f5-4f71-bd28-caf64c8620a9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:25.327641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143764b226ae4455a5b1ed5d5bfb2bd9', 'request_id': 'req-70472226-d3f5-4f71-bd28-caf64c8620a9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:25.342706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] The token cache is being invalidate because project 143764b226ae4455a5b1ed5d5bfb2bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:25.343026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:25.343689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-70472226-d3f5-4f71-bd28-caf64c8620a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:25.345277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1093/2165] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:25 2022] DELETE /identity/v3/projects/143764b226ae4455a5b1ed5d5bfb2bd9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:25.348961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02f22-78db-4a05-aad3-27d7fd7470f6 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.348961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02f22-78db-4a05-aad3-27d7fd7470f6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.348961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02f22-78db-4a05-aad3-27d7fd7470f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.376927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4ee02f22-78db-4a05-aad3-27d7fd7470f6 None None] MFA Rules not processed for user `2ad13a7d17ca46c7ae53d03fc2692f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:25.378145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4ee02f22-78db-4a05-aad3-27d7fd7470f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:25.386468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:25.394707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1073/2166] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:25.396072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0b5cc-1b22-4d54-a0b8-f1c87a836e75 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.396363 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0b5cc-1b22-4d54-a0b8-f1c87a836e75 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.396638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0b5cc-1b22-4d54-a0b8-f1c87a836e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.416733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-adc0b5cc-1b22-4d54-a0b8-f1c87a836e75 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:25.417950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-adc0b5cc-1b22-4d54-a0b8-f1c87a836e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:25.453740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1094/2167] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:25 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:25.454576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02f22-78db-4a05-aad3-27d7fd7470f6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.455945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4ee02f22-78db-4a05-aad3-27d7fd7470f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:25.471313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:25.484790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1074/2168] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:25.485682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0b5cc-1b22-4d54-a0b8-f1c87a836e75 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.487232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-adc0b5cc-1b22-4d54-a0b8-f1c87a836e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:25.534501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02f22-78db-4a05-aad3-27d7fd7470f6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.539475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d788008-f3a5-4c79-b3e5-662416cb6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.540087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d788008-f3a5-4c79-b3e5-662416cb6336 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.540369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d788008-f3a5-4c79-b3e5-662416cb6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.540648 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d788008-f3a5-4c79-b3e5-662416cb6336 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.541280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d788008-f3a5-4c79-b3e5-662416cb6336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.543258 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d788008-f3a5-4c79-b3e5-662416cb6336 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.551153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0b5cc-1b22-4d54-a0b8-f1c87a836e75 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.555030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d50a8-fa3e-4038-b64b-eb20b5ef9f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.555650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d50a8-fa3e-4038-b64b-eb20b5ef9f3f service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.555931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d50a8-fa3e-4038-b64b-eb20b5ef9f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.556206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d50a8-fa3e-4038-b64b-eb20b5ef9f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.566053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d50a8-fa3e-4038-b64b-eb20b5ef9f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.567628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d50a8-fa3e-4038-b64b-eb20b5ef9f3f service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.573683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1095/2169] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:25 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:25.575195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbaefe-e5ee-4df2-bc94-a9a8fdee518f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.575462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbaefe-e5ee-4df2-bc94-a9a8fdee518f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.575730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbaefe-e5ee-4df2-bc94-a9a8fdee518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.578158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1075/2170] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:25 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:25.578988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d50a8-fa3e-4038-b64b-eb20b5ef9f3f service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.590019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d50a8-fa3e-4038-b64b-eb20b5ef9f3f service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.597408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f9cbaefe-e5ee-4df2-bc94-a9a8fdee518f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:25.598629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f9cbaefe-e5ee-4df2-bc94-a9a8fdee518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:25.658375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88109-5b81-4aab-93b7-ac90e8a609d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.659041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88109-5b81-4aab-93b7-ac90e8a609d4 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.659287 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88109-5b81-4aab-93b7-ac90e8a609d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.659557 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88109-5b81-4aab-93b7-ac90e8a609d4 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.660213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88109-5b81-4aab-93b7-ac90e8a609d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.662141 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88109-5b81-4aab-93b7-ac90e8a609d4 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.671848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1096/2171] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:25.676030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbaefe-e5ee-4df2-bc94-a9a8fdee518f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.688212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbaefe-e5ee-4df2-bc94-a9a8fdee518f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.691590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1076/2172] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:25 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:25.693834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203dd6a-bc66-41d4-873b-e14a71d0f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.695628 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203dd6a-bc66-41d4-873b-e14a71d0f400 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.695628 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203dd6a-bc66-41d4-873b-e14a71d0f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.695628 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203dd6a-bc66-41d4-873b-e14a71d0f400 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.696228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203dd6a-bc66-41d4-873b-e14a71d0f400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:25.696323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88109-5b81-4aab-93b7-ac90e8a609d4 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.696458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203dd6a-bc66-41d4-873b-e14a71d0f400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.698183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203dd6a-bc66-41d4-873b-e14a71d0f400 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.707846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88109-5b81-4aab-93b7-ac90e8a609d4 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.711133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1097/2173] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:47:25.715347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a471-601f-4d7c-9524-1a02227dd1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.715953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203dd6a-bc66-41d4-873b-e14a71d0f400 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.716171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a471-601f-4d7c-9524-1a02227dd1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.716346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a471-601f-4d7c-9524-1a02227dd1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.716660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711a471-601f-4d7c-9524-1a02227dd1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.717352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a471-601f-4d7c-9524-1a02227dd1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.719082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711a471-601f-4d7c-9524-1a02227dd1e2 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.727169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203dd6a-bc66-41d4-873b-e14a71d0f400 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.731652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1077/2174] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:47:25.732613 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4027e52-5b08-4c28-964f-b75aa44ae8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.733249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4027e52-5b08-4c28-964f-b75aa44ae8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.733650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4027e52-5b08-4c28-964f-b75aa44ae8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.733906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4027e52-5b08-4c28-964f-b75aa44ae8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.734544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4027e52-5b08-4c28-964f-b75aa44ae8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.736921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4027e52-5b08-4c28-964f-b75aa44ae8b8 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.737839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a471-601f-4d7c-9524-1a02227dd1e2 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.765130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711a471-601f-4d7c-9524-1a02227dd1e2 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.776939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1098/2175] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:25 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:47:25.779162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a43a-d1d4-4758-b31b-911dd9815413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.779955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a43a-d1d4-4758-b31b-911dd9815413 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.780298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a43a-d1d4-4758-b31b-911dd9815413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.780585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a43a-d1d4-4758-b31b-911dd9815413 admin admin] PATH_INFO: `/v3/projects/8990e29b85264c208e2939bbe9675a61/users/7e842dfba40045f88f22a90360ed08b4/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.781268 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4027e52-5b08-4c28-964f-b75aa44ae8b8 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.798608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67a43a-d1d4-4758-b31b-911dd9815413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8990e29b85264c208e2939bbe9675a61, user_id=7e842dfba40045f88f22a90360ed08b4, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.801289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67a43a-d1d4-4758-b31b-911dd9815413 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.810484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:25.823491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1078/2176] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:25 2022] PUT /identity/v3/projects/8990e29b85264c208e2939bbe9675a61/users/7e842dfba40045f88f22a90360ed08b4/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:25.826955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a43a-d1d4-4758-b31b-911dd9815413 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.848369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4027e52-5b08-4c28-964f-b75aa44ae8b8 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.859292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:25.896962 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a43a-d1d4-4758-b31b-911dd9815413 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.901488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a844f4f-3a15-4b8d-b9aa-d6df02164e87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.902109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a844f4f-3a15-4b8d-b9aa-d6df02164e87 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.902394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a844f4f-3a15-4b8d-b9aa-d6df02164e87 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.902670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a844f4f-3a15-4b8d-b9aa-d6df02164e87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.904809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-0a844f4f-3a15-4b8d-b9aa-d6df02164e87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:25.920270 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18ad44-98eb-4910-8c9c-290352fb7421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.921690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18ad44-98eb-4910-8c9c-290352fb7421 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.922072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18ad44-98eb-4910-8c9c-290352fb7421 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.922442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18ad44-98eb-4910-8c9c-290352fb7421 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.933928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18ad44-98eb-4910-8c9c-290352fb7421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.933928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18ad44-98eb-4910-8c9c-290352fb7421 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.957398 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1099/2177] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:25 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:47:25.958429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18ad44-98eb-4910-8c9c-290352fb7421 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.969198 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18ad44-98eb-4910-8c9c-290352fb7421 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:25.973933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c68afa-1297-4bb9-b0ff-ea31f9e29bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:25.974531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c68afa-1297-4bb9-b0ff-ea31f9e29bee admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:25.974832 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c68afa-1297-4bb9-b0ff-ea31f9e29bee admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:25.975105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c68afa-1297-4bb9-b0ff-ea31f9e29bee admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:25.975945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c68afa-1297-4bb9-b0ff-ea31f9e29bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.978188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c68afa-1297-4bb9-b0ff-ea31f9e29bee admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.980930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a844f4f-3a15-4b8d-b9aa-d6df02164e87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:25.982666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a844f4f-3a15-4b8d-b9aa-d6df02164e87 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:25.988523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1100/2178] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:25.988523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c68afa-1297-4bb9-b0ff-ea31f9e29bee admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:25.995895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1079/2179] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:25 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:25.996391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a844f4f-3a15-4b8d-b9aa-d6df02164e87 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.002278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c68afa-1297-4bb9-b0ff-ea31f9e29bee admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.006875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a844f4f-3a15-4b8d-b9aa-d6df02164e87 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.009314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f90226-10da-46fa-a88c-0b144e99c1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.010047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f90226-10da-46fa-a88c-0b144e99c1ae admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.010377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f90226-10da-46fa-a88c-0b144e99c1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.010734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f90226-10da-46fa-a88c-0b144e99c1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.011534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f90226-10da-46fa-a88c-0b144e99c1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.012397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d71bc-4752-4017-8b97-cfd25a88aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.013121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d71bc-4752-4017-8b97-cfd25a88aa2a admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.013465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d71bc-4752-4017-8b97-cfd25a88aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.013682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f90226-10da-46fa-a88c-0b144e99c1ae admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.013865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d71bc-4752-4017-8b97-cfd25a88aa2a admin admin] PATH_INFO: `/v3/projects/8990e29b85264c208e2939bbe9675a61/users/7e842dfba40045f88f22a90360ed08b4/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.015883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d71bc-4752-4017-8b97-cfd25a88aa2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8990e29b85264c208e2939bbe9675a61, user_id=7e842dfba40045f88f22a90360ed08b4, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.018596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d71bc-4752-4017-8b97-cfd25a88aa2a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.031922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1101/2180] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:26.032177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1080/2181] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:25 2022] PUT /identity/v3/projects/8990e29b85264c208e2939bbe9675a61/users/7e842dfba40045f88f22a90360ed08b4/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:26.033552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f90226-10da-46fa-a88c-0b144e99c1ae admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.042273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef16e-97c5-45a4-a211-6c151035edcf None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.042587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef16e-97c5-45a4-a211-6c151035edcf None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.042898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef16e-97c5-45a4-a211-6c151035edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.046923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f90226-10da-46fa-a88c-0b144e99c1ae admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.089083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-1cbef16e-97c5-45a4-a211-6c151035edcf None None] MFA Rules not processed for user `7e842dfba40045f88f22a90360ed08b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:26.090319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1cbef16e-97c5-45a4-a211-6c151035edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:26.117434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072baae-69bd-49b9-b201-0252f44e42ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.118025 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072baae-69bd-49b9-b201-0252f44e42ef admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.118368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072baae-69bd-49b9-b201-0252f44e42ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.119442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072baae-69bd-49b9-b201-0252f44e42ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.119442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072baae-69bd-49b9-b201-0252f44e42ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.121220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072baae-69bd-49b9-b201-0252f44e42ef admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.132169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1102/2182] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:26.136282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072baae-69bd-49b9-b201-0252f44e42ef admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.147465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072baae-69bd-49b9-b201-0252f44e42ef admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.153577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700f7b-dd68-4798-8100-e84a17066b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.154221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700f7b-dd68-4798-8100-e84a17066b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.154504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700f7b-dd68-4798-8100-e84a17066b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.154795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700f7b-dd68-4798-8100-e84a17066b85 admin admin] PATH_INFO: `/v3/projects/6329ee7e7b9d4a7996a21bbe64b9e4a7/users/a2113c650d664451a093ee51fcac92da/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.174324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1081/2183] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:26.174547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700f7b-dd68-4798-8100-e84a17066b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6329ee7e7b9d4a7996a21bbe64b9e4a7, user_id=a2113c650d664451a093ee51fcac92da, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.178246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700f7b-dd68-4798-8100-e84a17066b85 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.188984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef16e-97c5-45a4-a211-6c151035edcf None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.191145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1cbef16e-97c5-45a4-a211-6c151035edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:26.196182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1103/2184] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:26 2022] PUT /identity/v3/projects/6329ee7e7b9d4a7996a21bbe64b9e4a7/users/a2113c650d664451a093ee51fcac92da/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:26.206267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3052d16-6963-4875-8e06-f7e340b843db None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.206627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3052d16-6963-4875-8e06-f7e340b843db None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.207662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3052d16-6963-4875-8e06-f7e340b843db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.223420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:26.238325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b3052d16-6963-4875-8e06-f7e340b843db None None] MFA Rules not processed for user `a2113c650d664451a093ee51fcac92da`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:26.239662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b3052d16-6963-4875-8e06-f7e340b843db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:26.270814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef16e-97c5-45a4-a211-6c151035edcf None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.299676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:26.377734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf9a98-8514-49d8-8041-747a8fa152d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.380724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1104/2185] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:26.383757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf9a98-8514-49d8-8041-747a8fa152d1 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.384322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf9a98-8514-49d8-8041-747a8fa152d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.385063 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf9a98-8514-49d8-8041-747a8fa152d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.387896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3052d16-6963-4875-8e06-f7e340b843db None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.496831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf9a98-8514-49d8-8041-747a8fa152d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.498814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf9a98-8514-49d8-8041-747a8fa152d1 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.508464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3052d16-6963-4875-8e06-f7e340b843db None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.510033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1082/2186] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:26.513237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26431758-cf2b-4a67-bf74-c6f426462831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.513851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26431758-cf2b-4a67-bf74-c6f426462831 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.514133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26431758-cf2b-4a67-bf74-c6f426462831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.514407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26431758-cf2b-4a67-bf74-c6f426462831 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.515083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26431758-cf2b-4a67-bf74-c6f426462831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.517094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26431758-cf2b-4a67-bf74-c6f426462831 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.561767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1105/2187] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:26 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:26.562029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf9a98-8514-49d8-8041-747a8fa152d1 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.569081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf9a98-8514-49d8-8041-747a8fa152d1 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.667037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d93e1-92dc-41ac-a0d3-c314cfcff36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.667696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d93e1-92dc-41ac-a0d3-c314cfcff36e admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.667974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d93e1-92dc-41ac-a0d3-c314cfcff36e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.668317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d93e1-92dc-41ac-a0d3-c314cfcff36e admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.669097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d93e1-92dc-41ac-a0d3-c314cfcff36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.671346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d93e1-92dc-41ac-a0d3-c314cfcff36e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.698804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1083/2188] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:26 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:26.702164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26431758-cf2b-4a67-bf74-c6f426462831 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.715573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26431758-cf2b-4a67-bf74-c6f426462831 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.721715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828d232-5cde-4b47-b603-70bb9fe67f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.722443 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828d232-5cde-4b47-b603-70bb9fe67f98 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.722872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828d232-5cde-4b47-b603-70bb9fe67f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.723271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828d232-5cde-4b47-b603-70bb9fe67f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.724021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828d232-5cde-4b47-b603-70bb9fe67f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.725708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828d232-5cde-4b47-b603-70bb9fe67f98 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.746513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1106/2189] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:26.747523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d93e1-92dc-41ac-a0d3-c314cfcff36e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.759157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d93e1-92dc-41ac-a0d3-c314cfcff36e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.765032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5f24b-7b72-4ee5-916f-a0f0e865db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.765695 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5f24b-7b72-4ee5-916f-a0f0e865db5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.765975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5f24b-7b72-4ee5-916f-a0f0e865db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.766247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5f24b-7b72-4ee5-916f-a0f0e865db5f admin admin] PATH_INFO: `/v3/projects/2b09c99b982143cb803864193ddbb891/users/95ee0fc9e8d7407ab96ad8bbddaad8b8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.785105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5f24b-7b72-4ee5-916f-a0f0e865db5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b09c99b982143cb803864193ddbb891, user_id=95ee0fc9e8d7407ab96ad8bbddaad8b8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.787799 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5f24b-7b72-4ee5-916f-a0f0e865db5f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.791326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:26.804766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1084/2190] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:26 2022] PUT /identity/v3/projects/2b09c99b982143cb803864193ddbb891/users/95ee0fc9e8d7407ab96ad8bbddaad8b8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:26.808828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828d232-5cde-4b47-b603-70bb9fe67f98 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.824081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828d232-5cde-4b47-b603-70bb9fe67f98 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.903992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5f24b-7b72-4ee5-916f-a0f0e865db5f admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.917328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee7e2b-baa5-4a79-a29d-d7d6729a2983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.917949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee7e2b-baa5-4a79-a29d-d7d6729a2983 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.918229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee7e2b-baa5-4a79-a29d-d7d6729a2983 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.918502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee7e2b-baa5-4a79-a29d-d7d6729a2983 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.919195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee7e2b-baa5-4a79-a29d-d7d6729a2983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.920995 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee7e2b-baa5-4a79-a29d-d7d6729a2983 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.935048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1107/2191] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:26.938985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee7e2b-baa5-4a79-a29d-d7d6729a2983 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:26.953622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee7e2b-baa5-4a79-a29d-d7d6729a2983 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:26.959034 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab07ea-ade9-443d-af9e-1c0a740248e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:26.959701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab07ea-ade9-443d-af9e-1c0a740248e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.959983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab07ea-ade9-443d-af9e-1c0a740248e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.960600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab07ea-ade9-443d-af9e-1c0a740248e6 admin admin] PATH_INFO: `/v3/projects/2b09c99b982143cb803864193ddbb891/users/95ee0fc9e8d7407ab96ad8bbddaad8b8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:26.963944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab07ea-ade9-443d-af9e-1c0a740248e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b09c99b982143cb803864193ddbb891, user_id=95ee0fc9e8d7407ab96ad8bbddaad8b8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:26.966640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab07ea-ade9-443d-af9e-1c0a740248e6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:26.986876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1108/2192] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:26 2022] PUT /identity/v3/projects/2b09c99b982143cb803864193ddbb891/users/95ee0fc9e8d7407ab96ad8bbddaad8b8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:26.990732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fc6be-ad98-41d4-a625-e366ff36c3f6 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:26.991041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fc6be-ad98-41d4-a625-e366ff36c3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:26.991320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fc6be-ad98-41d4-a625-e366ff36c3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:27.015383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5f24b-7b72-4ee5-916f-a0f0e865db5f admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:27.024946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-988fc6be-ad98-41d4-a625-e366ff36c3f6 None None] MFA Rules not processed for user `95ee0fc9e8d7407ab96ad8bbddaad8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:27.027598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-988fc6be-ad98-41d4-a625-e366ff36c3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:27.060103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:27.099554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001cf7-756b-47f3-9c7e-5465c4ec7142 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e842dfba40045f88f22a90360ed08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8990e29b85264c208e2939bbe9675a61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:27.100186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001cf7-756b-47f3-9c7e-5465c4ec7142 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:27.100480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001cf7-756b-47f3-9c7e-5465c4ec7142 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:27.101288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001cf7-756b-47f3-9c7e-5465c4ec7142 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:27.101961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001cf7-756b-47f3-9c7e-5465c4ec7142 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:27.102387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001cf7-756b-47f3-9c7e-5465c4ec7142 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:27.104032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001cf7-756b-47f3-9c7e-5465c4ec7142 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:27.115836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1109/2193] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:27.126004 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1085/2194] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:47:27.127387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fc6be-ad98-41d4-a625-e366ff36c3f6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:27.130299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001cf7-756b-47f3-9c7e-5465c4ec7142 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:27.142699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001cf7-756b-47f3-9c7e-5465c4ec7142 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:27.148718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b068c9-a633-41bc-ac3c-9ba1c3f7bcdd tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e842dfba40045f88f22a90360ed08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8990e29b85264c208e2939bbe9675a61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:27.149338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b068c9-a633-41bc-ac3c-9ba1c3f7bcdd tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:27.149622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b068c9-a633-41bc-ac3c-9ba1c3f7bcdd tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:27.150318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b068c9-a633-41bc-ac3c-9ba1c3f7bcdd tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:27.150519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b068c9-a633-41bc-ac3c-9ba1c3f7bcdd tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:27.152526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b068c9-a633-41bc-ac3c-9ba1c3f7bcdd tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:27.196680 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1086/2195] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:27 2022] POST /identity/v3/projects => generated 355 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:27.200926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b068c9-a633-41bc-ac3c-9ba1c3f7bcdd tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:27.204382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fc6be-ad98-41d4-a625-e366ff36c3f6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:27.275756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4eccb4-e9b4-4678-b3a9-8d3d315462f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:27.277673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eccb4-e9b4-4678-b3a9-8d3d315462f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:27.278424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eccb4-e9b4-4678-b3a9-8d3d315462f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:27.279235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eccb4-e9b4-4678-b3a9-8d3d315462f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:27.281996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b068c9-a633-41bc-ac3c-9ba1c3f7bcdd tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:27.289130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a905de-f431-46ba-97aa-01033152e434 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e842dfba40045f88f22a90360ed08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8990e29b85264c208e2939bbe9675a61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:27.290966 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a905de-f431-46ba-97aa-01033152e434 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:27.291524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a905de-f431-46ba-97aa-01033152e434 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:27.291825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a905de-f431-46ba-97aa-01033152e434 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:27.292565 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a905de-f431-46ba-97aa-01033152e434 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:27.292878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a905de-f431-46ba-97aa-01033152e434 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:27.294735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a905de-f431-46ba-97aa-01033152e434 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:27.312710 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1087/2196] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:27.348988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4eccb4-e9b4-4678-b3a9-8d3d315462f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:27.350385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4eccb4-e9b4-4678-b3a9-8d3d315462f5 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:27.352040 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a905de-f431-46ba-97aa-01033152e434 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:27.360204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1110/2197] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:27.362159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a905de-f431-46ba-97aa-01033152e434 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:27.367471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e842dfba40045f88f22a90360ed08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8990e29b85264c208e2939bbe9675a61', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:27.368314 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:27.368598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:27.368875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] PATH_INFO: `/v3/projects/dd478fb82e2e49068a9e1561818a3dee` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:27.370114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd478fb82e2e49068a9e1561818a3dee)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:27.372193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:27.374722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:27.438853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd478fb82e2e49068a9e1561818a3dee', 'request_id': 'req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:27.448560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd478fb82e2e49068a9e1561818a3dee', 'request_id': 'req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:27.456978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd478fb82e2e49068a9e1561818a3dee', 'request_id': 'req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:27.472706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] The token cache is being invalidate because project dd478fb82e2e49068a9e1561818a3dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:27.473093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:27.473895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f26bf0ce-d786-4481-ac61-e3ae788b4ba8 tempest-VolumeQuotaClassesTest-529251244 tempest-VolumeQuotaClassesTest-529251244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:27.476196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1088/2198] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:27 2022] DELETE /identity/v3/projects/dd478fb82e2e49068a9e1561818a3dee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:27.835214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4eccb4-e9b4-4678-b3a9-8d3d315462f5 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:27.879667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:27.908841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4eccb4-e9b4-4678-b3a9-8d3d315462f5 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:27.972903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:27.973561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:27.973808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:27.974082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] PATH_INFO: `/v3/users/956dbcbb35a1474396078df53132bc44` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:27.975235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956dbcbb35a1474396078df53132bc44)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:27.977779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:28.031839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956dbcbb35a1474396078df53132bc44'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.032501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956dbcbb35a1474396078df53132bc44'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.033117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956dbcbb35a1474396078df53132bc44'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.041608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956dbcbb35a1474396078df53132bc44'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.049261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956dbcbb35a1474396078df53132bc44'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.068216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1111/2199] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:27 2022] DELETE /identity/v3/users/956dbcbb35a1474396078df53132bc44 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:28.073246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c187fa-73ff-4dce-9c5b-bcb5620e2771 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:28.073746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c187fa-73ff-4dce-9c5b-bcb5620e2771 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:28.073836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c187fa-73ff-4dce-9c5b-bcb5620e2771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:28.093293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f3c187fa-73ff-4dce-9c5b-bcb5620e2771 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:28.094499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f3c187fa-73ff-4dce-9c5b-bcb5620e2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:28.154818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1089/2200] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:28.165125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:28.166518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:28.230882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aa04d-92d0-4e42-90b6-8106dab7cc88 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:28.234558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2c57-ffa7-43a1-8c66-7405c1f17f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:28.235196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2c57-ffa7-43a1-8c66-7405c1f17f4c service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:28.235474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2c57-ffa7-43a1-8c66-7405c1f17f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:28.235742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2c57-ffa7-43a1-8c66-7405c1f17f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:28.246466 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2c57-ffa7-43a1-8c66-7405c1f17f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:28.247948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2c57-ffa7-43a1-8c66-7405c1f17f4c service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:28.258577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1112/2201] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:28.592711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c187fa-73ff-4dce-9c5b-bcb5620e2771 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:28.594167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f3c187fa-73ff-4dce-9c5b-bcb5620e2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:28.610084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c187fa-73ff-4dce-9c5b-bcb5620e2771 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:28.615230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:28.615868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:28.616147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:28.616417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] PATH_INFO: `/v3/projects/83109f1b2e8340e2a5c2f31ec89c7875` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:28.618462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83109f1b2e8340e2a5c2f31ec89c7875)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:28.620414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:28.669196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83109f1b2e8340e2a5c2f31ec89c7875', 'request_id': 'req-f903b406-b97a-431a-a56f-78780efac411'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.676980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83109f1b2e8340e2a5c2f31ec89c7875', 'request_id': 'req-f903b406-b97a-431a-a56f-78780efac411'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.682682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83109f1b2e8340e2a5c2f31ec89c7875', 'request_id': 'req-f903b406-b97a-431a-a56f-78780efac411'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.693756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] The token cache is being invalidate because project 83109f1b2e8340e2a5c2f31ec89c7875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:28.694048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.695203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.696688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1090/2202] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:28 2022] DELETE /identity/v3/projects/83109f1b2e8340e2a5c2f31ec89c7875 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:28.700712 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2c57-ffa7-43a1-8c66-7405c1f17f4c service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:28.705590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:28.712888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2c57-ffa7-43a1-8c66-7405c1f17f4c service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:28.777068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:28.777774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:28.778038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:28.778382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] PATH_INFO: `/v3/users/7e842dfba40045f88f22a90360ed08b4` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:28.779672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e842dfba40045f88f22a90360ed08b4)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:28.781676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:28.840072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e842dfba40045f88f22a90360ed08b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.840890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e842dfba40045f88f22a90360ed08b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.841532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e842dfba40045f88f22a90360ed08b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.849455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e842dfba40045f88f22a90360ed08b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.857330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bd4b80b6-16b0-49f2-a386-9406ef7025f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e842dfba40045f88f22a90360ed08b4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:28.883988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1113/2203] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:28 2022] DELETE /identity/v3/users/7e842dfba40045f88f22a90360ed08b4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:29.198893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:29.200522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:29.227727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903b406-b97a-431a-a56f-78780efac411 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:29.240726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:29.291021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:29.291589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.291867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.292140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] PATH_INFO: `/v3/projects/8990e29b85264c208e2939bbe9675a61` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.293271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8990e29b85264c208e2939bbe9675a61)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:29.295245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:29.342801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8990e29b85264c208e2939bbe9675a61', 'request_id': 'req-278cda95-98b5-4ed0-8a89-edaf78fef4a6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:29.350254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8990e29b85264c208e2939bbe9675a61', 'request_id': 'req-278cda95-98b5-4ed0-8a89-edaf78fef4a6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:29.357426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8990e29b85264c208e2939bbe9675a61', 'request_id': 'req-278cda95-98b5-4ed0-8a89-edaf78fef4a6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:29.370018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] The token cache is being invalidate because project 8990e29b85264c208e2939bbe9675a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:29.370333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:29.371071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-278cda95-98b5-4ed0-8a89-edaf78fef4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:29.373182 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1091/2204] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:29 2022] DELETE /identity/v3/projects/8990e29b85264c208e2939bbe9675a61 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:29.379015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10ceba-afb7-46e0-b3bd-6056536963fb None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.379514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10ceba-afb7-46e0-b3bd-6056536963fb None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.379700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10ceba-afb7-46e0-b3bd-6056536963fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.401955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6b10ceba-afb7-46e0-b3bd-6056536963fb None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:29.403389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6b10ceba-afb7-46e0-b3bd-6056536963fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:29.487412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1114/2205] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:29.496025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5ebff-edad-4661-848c-429f71b80484 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.496315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5ebff-edad-4661-848c-429f71b80484 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.496715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5ebff-edad-4661-848c-429f71b80484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.520001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e2d5ebff-edad-4661-848c-429f71b80484 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:29.521325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e2d5ebff-edad-4661-848c-429f71b80484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:29.534884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1092/2206] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:29.536327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10ceba-afb7-46e0-b3bd-6056536963fb None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:29.547724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10ceba-afb7-46e0-b3bd-6056536963fb None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:29.552607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721bafd-6502-4164-abeb-f4efb6c18053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:29.553222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721bafd-6502-4164-abeb-f4efb6c18053 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.553500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721bafd-6502-4164-abeb-f4efb6c18053 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.553826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721bafd-6502-4164-abeb-f4efb6c18053 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.554482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721bafd-6502-4164-abeb-f4efb6c18053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:29.555002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721bafd-6502-4164-abeb-f4efb6c18053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:29.556626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721bafd-6502-4164-abeb-f4efb6c18053 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:29.572893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1115/2207] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:29.574034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5ebff-edad-4661-848c-429f71b80484 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:29.583643 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5ebff-edad-4661-848c-429f71b80484 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:29.589095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e02dd4-0050-4f67-9702-f4ca39d16a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:29.589788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e02dd4-0050-4f67-9702-f4ca39d16a74 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.590133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e02dd4-0050-4f67-9702-f4ca39d16a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.590465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e02dd4-0050-4f67-9702-f4ca39d16a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.591225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e02dd4-0050-4f67-9702-f4ca39d16a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:29.593378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e02dd4-0050-4f67-9702-f4ca39d16a74 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:29.622926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1093/2208] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:29 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:47:29.627013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721bafd-6502-4164-abeb-f4efb6c18053 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:29.637596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721bafd-6502-4164-abeb-f4efb6c18053 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:29.642363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:29.699293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b16c4-79e6-4d28-b622-6a88d5c5c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:29.699876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b16c4-79e6-4d28-b622-6a88d5c5c366 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.700173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b16c4-79e6-4d28-b622-6a88d5c5c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.700434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b16c4-79e6-4d28-b622-6a88d5c5c366 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.701073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b16c4-79e6-4d28-b622-6a88d5c5c366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:29.703027 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b16c4-79e6-4d28-b622-6a88d5c5c366 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:29.725106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1116/2209] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:29 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:29.730404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e02dd4-0050-4f67-9702-f4ca39d16a74 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:29.740883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e02dd4-0050-4f67-9702-f4ca39d16a74 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:29.746066 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704c40a-9222-40a9-b454-119cb2cd3f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:29.746688 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c40a-9222-40a9-b454-119cb2cd3f0e admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.747001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c40a-9222-40a9-b454-119cb2cd3f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.747274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c40a-9222-40a9-b454-119cb2cd3f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.747918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704c40a-9222-40a9-b454-119cb2cd3f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:29.749518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704c40a-9222-40a9-b454-119cb2cd3f0e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:29.760520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1094/2210] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:29.764563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b16c4-79e6-4d28-b622-6a88d5c5c366 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:29.775958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b16c4-79e6-4d28-b622-6a88d5c5c366 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:29.780621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6d7a8-ab9c-45a6-a041-b341149bec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:29.781220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d7a8-ab9c-45a6-a041-b341149bec21 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.781503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d7a8-ab9c-45a6-a041-b341149bec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.781779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d7a8-ab9c-45a6-a041-b341149bec21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.782438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d7a8-ab9c-45a6-a041-b341149bec21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:29.784091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d7a8-ab9c-45a6-a041-b341149bec21 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:29.795924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1117/2211] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:29.800052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704c40a-9222-40a9-b454-119cb2cd3f0e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:29.810454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704c40a-9222-40a9-b454-119cb2cd3f0e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:29.815107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f4fd7-82f8-4752-a1b8-00f2a31b6e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:29.815751 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f4fd7-82f8-4752-a1b8-00f2a31b6e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.816033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f4fd7-82f8-4752-a1b8-00f2a31b6e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.816310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f4fd7-82f8-4752-a1b8-00f2a31b6e26 admin admin] PATH_INFO: `/v3/projects/c7234b448bc34f5bb97ac1813dca4f0b/users/86ee86e8317f4c22b536002f01de1624/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.831445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f4fd7-82f8-4752-a1b8-00f2a31b6e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7234b448bc34f5bb97ac1813dca4f0b, user_id=86ee86e8317f4c22b536002f01de1624, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:29.834114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f4fd7-82f8-4752-a1b8-00f2a31b6e26 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:29.848129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1095/2212] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:29 2022] PUT /identity/v3/projects/c7234b448bc34f5bb97ac1813dca4f0b/users/86ee86e8317f4c22b536002f01de1624/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:29.859232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790154f-a3f8-47e0-832f-6169158c3b8e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:29.859515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790154f-a3f8-47e0-832f-6169158c3b8e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:29.859791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790154f-a3f8-47e0-832f-6169158c3b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:29.888486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6790154f-a3f8-47e0-832f-6169158c3b8e None None] MFA Rules not processed for user `86ee86e8317f4c22b536002f01de1624`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:29.889715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6790154f-a3f8-47e0-832f-6169158c3b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:29.966439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1118/2213] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:29.978430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f4fd7-82f8-4752-a1b8-00f2a31b6e26 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:29.980139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d83f4fd7-82f8-4752-a1b8-00f2a31b6e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:30.026928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:30.040525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790154f-a3f8-47e0-832f-6169158c3b8e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:30.040882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f4fd7-82f8-4752-a1b8-00f2a31b6e26 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:30.041929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6790154f-a3f8-47e0-832f-6169158c3b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:30.045017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f3c8-8d6d-4a12-88e4-7d4f22c5d48e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:30.045610 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f3c8-8d6d-4a12-88e4-7d4f22c5d48e service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:30.045951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f3c8-8d6d-4a12-88e4-7d4f22c5d48e service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:30.046402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f3c8-8d6d-4a12-88e4-7d4f22c5d48e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:30.054951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2f3c8-8d6d-4a12-88e4-7d4f22c5d48e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:30.056514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2f3c8-8d6d-4a12-88e4-7d4f22c5d48e service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:30.065802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1096/2214] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:30.088026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f3c8-8d6d-4a12-88e4-7d4f22c5d48e service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:30.111870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790154f-a3f8-47e0-832f-6169158c3b8e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:30.117609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:30.118364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:30.118742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:30.119165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] PATH_INFO: `/v3/users/a2113c650d664451a093ee51fcac92da` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:30.120435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2113c650d664451a093ee51fcac92da)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:30.122363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:30.144629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:30.153493 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f3c8-8d6d-4a12-88e4-7d4f22c5d48e service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:30.159202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:30.159843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:30.160128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:30.160458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] PATH_INFO: `/v3/users/86ee86e8317f4c22b536002f01de1624` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:30.161949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ee86e8317f4c22b536002f01de1624)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:30.164561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:30.174159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2113c650d664451a093ee51fcac92da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.174862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2113c650d664451a093ee51fcac92da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.175507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2113c650d664451a093ee51fcac92da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.183332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2113c650d664451a093ee51fcac92da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.192484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94c47d03-9236-4981-b19b-d67359b86383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2113c650d664451a093ee51fcac92da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.213215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1119/2215] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:30 2022] DELETE /identity/v3/users/a2113c650d664451a093ee51fcac92da => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:30.217366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ee86e8317f4c22b536002f01de1624'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.217815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dafe29-7140-4065-a955-476084e8ee63 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:30.217815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dafe29-7140-4065-a955-476084e8ee63 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:30.218098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dafe29-7140-4065-a955-476084e8ee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:30.224744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ee86e8317f4c22b536002f01de1624'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.225440 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ee86e8317f4c22b536002f01de1624'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.237616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-32dafe29-7140-4065-a955-476084e8ee63 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:30.238553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ee86e8317f4c22b536002f01de1624'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.238874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-32dafe29-7140-4065-a955-476084e8ee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:30.239286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-d6230031-d615-4932-996d-64bf1c6a1254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ee86e8317f4c22b536002f01de1624'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:30.259011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1097/2216] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:30 2022] DELETE /identity/v3/users/86ee86e8317f4c22b536002f01de1624 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:30.261132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233988ee-23f2-4fc7-8b34-b6e606fe8437 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:30.262049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233988ee-23f2-4fc7-8b34-b6e606fe8437 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:30.262448 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233988ee-23f2-4fc7-8b34-b6e606fe8437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:30.285771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-233988ee-23f2-4fc7-8b34-b6e606fe8437 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:30.286985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-233988ee-23f2-4fc7-8b34-b6e606fe8437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:30.318627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1120/2217] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:30.329460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dafe29-7140-4065-a955-476084e8ee63 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:30.335432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-32dafe29-7140-4065-a955-476084e8ee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:30.390453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1098/2218] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:30.391692 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233988ee-23f2-4fc7-8b34-b6e606fe8437 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:30.393236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-233988ee-23f2-4fc7-8b34-b6e606fe8437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:30.400670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:30.404464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dafe29-7140-4065-a955-476084e8ee63 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:30.458459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233988ee-23f2-4fc7-8b34-b6e606fe8437 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:30.458877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885329f-05cc-417a-aa48-23b593de9332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:30.459532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885329f-05cc-417a-aa48-23b593de9332 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:30.459815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885329f-05cc-417a-aa48-23b593de9332 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:30.460154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885329f-05cc-417a-aa48-23b593de9332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:30.464324 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f965e-c5b2-4ac6-ac18-5c9f9a0baa8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:30.464985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f965e-c5b2-4ac6-ac18-5c9f9a0baa8e service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:30.465272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f965e-c5b2-4ac6-ac18-5c9f9a0baa8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:30.465594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f965e-c5b2-4ac6-ac18-5c9f9a0baa8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:30.470491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:30.473478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885329f-05cc-417a-aa48-23b593de9332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:30.475498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885329f-05cc-417a-aa48-23b593de9332 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:30.478225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f965e-c5b2-4ac6-ac18-5c9f9a0baa8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:30.479743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f965e-c5b2-4ac6-ac18-5c9f9a0baa8e service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:30.490838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1121/2219] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:30.492676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1099/2220] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:31.024914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f965e-c5b2-4ac6-ac18-5c9f9a0baa8e service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.026376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bb6f965e-c5b2-4ac6-ac18-5c9f9a0baa8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.030841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885329f-05cc-417a-aa48-23b593de9332 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.032221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f885329f-05cc-417a-aa48-23b593de9332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.050410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f965e-c5b2-4ac6-ac18-5c9f9a0baa8e service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.051206 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885329f-05cc-417a-aa48-23b593de9332 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.056491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.057221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.057611 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.057888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] PATH_INFO: `/v3/projects/6329ee7e7b9d4a7996a21bbe64b9e4a7` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.058168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.059123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6329ee7e7b9d4a7996a21bbe64b9e4a7)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.059235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.059468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.059748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] PATH_INFO: `/v3/projects/c7234b448bc34f5bb97ac1813dca4f0b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.061051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7234b448bc34f5bb97ac1813dca4f0b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.061407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.064471 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.119362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7234b448bc34f5bb97ac1813dca4f0b', 'request_id': 'req-07dc415a-3dec-4253-a344-343ff6a16e57'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.123183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6329ee7e7b9d4a7996a21bbe64b9e4a7', 'request_id': 'req-79590136-8a90-481a-b174-a43129238d20'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.126391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7234b448bc34f5bb97ac1813dca4f0b', 'request_id': 'req-07dc415a-3dec-4253-a344-343ff6a16e57'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.131381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6329ee7e7b9d4a7996a21bbe64b9e4a7', 'request_id': 'req-79590136-8a90-481a-b174-a43129238d20'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.132692 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7234b448bc34f5bb97ac1813dca4f0b', 'request_id': 'req-07dc415a-3dec-4253-a344-343ff6a16e57'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.137402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6329ee7e7b9d4a7996a21bbe64b9e4a7', 'request_id': 'req-79590136-8a90-481a-b174-a43129238d20'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.146493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] The token cache is being invalidate because project c7234b448bc34f5bb97ac1813dca4f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:31.146790 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.147930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-07dc415a-3dec-4253-a344-343ff6a16e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.149505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1122/2221] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:31 2022] DELETE /identity/v3/projects/c7234b448bc34f5bb97ac1813dca4f0b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:31.153601 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] The token cache is being invalidate because project 6329ee7e7b9d4a7996a21bbe64b9e4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:31.153896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.154353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4a4b2-535c-42b2-8fe9-b05ed14ea34e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.154574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.154806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4a4b2-535c-42b2-8fe9-b05ed14ea34e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.155158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4a4b2-535c-42b2-8fe9-b05ed14ea34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.157372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1100/2222] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:31 2022] DELETE /identity/v3/projects/6329ee7e7b9d4a7996a21bbe64b9e4a7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:31.159826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.161227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.176110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-fda4a4b2-535c-42b2-8fe9-b05ed14ea34e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:31.177317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-fda4a4b2-535c-42b2-8fe9-b05ed14ea34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.228897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79590136-8a90-481a-b174-a43129238d20 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.234970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.235820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.236173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.236455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] PATH_INFO: `/v3/users/95ee0fc9e8d7407ab96ad8bbddaad8b8` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.237616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ee0fc9e8d7407ab96ad8bbddaad8b8)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.239592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.244573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1123/2223] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:31.253138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cc614-e38c-4bea-b160-886ffcbc8b38 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.253431 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cc614-e38c-4bea-b160-886ffcbc8b38 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.253701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cc614-e38c-4bea-b160-886ffcbc8b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.274143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-0c4cc614-e38c-4bea-b160-886ffcbc8b38 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:31.275295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0c4cc614-e38c-4bea-b160-886ffcbc8b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.281458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:31.285919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1124/2224] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:31.291340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cc614-e38c-4bea-b160-886ffcbc8b38 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.297978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ee0fc9e8d7407ab96ad8bbddaad8b8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.300707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cc614-e38c-4bea-b160-886ffcbc8b38 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.306100 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.306241 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ee0fc9e8d7407ab96ad8bbddaad8b8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.306694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.306952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ee0fc9e8d7407ab96ad8bbddaad8b8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.307078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.307272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.308034 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:31.308210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.309804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.320588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ee0fc9e8d7407ab96ad8bbddaad8b8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.321293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ee0fc9e8d7407ab96ad8bbddaad8b8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.322521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1125/2225] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:47:31.327047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.328947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.334708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1101/2226] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:31 2022] DELETE /identity/v3/users/95ee0fc9e8d7407ab96ad8bbddaad8b8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:31.343115 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf88ab-9aef-4cbd-b0e1-eb057fa234cc admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.406386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0074a2-5a91-4103-b546-e8c5bd91bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.407747 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0074a2-5a91-4103-b546-e8c5bd91bf03 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.408096 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0074a2-5a91-4103-b546-e8c5bd91bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.408464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0074a2-5a91-4103-b546-e8c5bd91bf03 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.409197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0074a2-5a91-4103-b546-e8c5bd91bf03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.411246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0074a2-5a91-4103-b546-e8c5bd91bf03 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.418021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:31.454504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1126/2227] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:31 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:47:31.459238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.471237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e8851-088a-48f2-9a3a-4655f80c54a5 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.559244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb7dff-8f73-46ad-ad19-c5959df9a354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.559909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb7dff-8f73-46ad-ad19-c5959df9a354 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.560189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb7dff-8f73-46ad-ad19-c5959df9a354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.560466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb7dff-8f73-46ad-ad19-c5959df9a354 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.561253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb7dff-8f73-46ad-ad19-c5959df9a354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.563263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb7dff-8f73-46ad-ad19-c5959df9a354 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.590161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1102/2228] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:31 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:31.594346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0074a2-5a91-4103-b546-e8c5bd91bf03 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.605708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0074a2-5a91-4103-b546-e8c5bd91bf03 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.611287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44d805-f9e1-4267-83e4-69774c71ccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.612046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44d805-f9e1-4267-83e4-69774c71ccb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.612343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb7dff-8f73-46ad-ad19-c5959df9a354 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.612462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44d805-f9e1-4267-83e4-69774c71ccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.612777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44d805-f9e1-4267-83e4-69774c71ccb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.613531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44d805-f9e1-4267-83e4-69774c71ccb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.615013 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-12fb7dff-8f73-46ad-ad19-c5959df9a354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.615305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44d805-f9e1-4267-83e4-69774c71ccb0 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.629094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1127/2229] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:47:31.629358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb7dff-8f73-46ad-ad19-c5959df9a354 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.633528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44d805-f9e1-4267-83e4-69774c71ccb0 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.634331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.635480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.635761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.636050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] PATH_INFO: `/v3/users/ece7040f8ae648728cd40ce098135fc3` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.637359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece7040f8ae648728cd40ce098135fc3)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.639381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.647954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44d805-f9e1-4267-83e4-69774c71ccb0 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.653409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e49943-4c74-44c1-8d1c-6539bedca469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.654019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e49943-4c74-44c1-8d1c-6539bedca469 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.654569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e49943-4c74-44c1-8d1c-6539bedca469 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.654569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e49943-4c74-44c1-8d1c-6539bedca469 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.655416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e49943-4c74-44c1-8d1c-6539bedca469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.657118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e49943-4c74-44c1-8d1c-6539bedca469 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.668716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1128/2230] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:31.669602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e49943-4c74-44c1-8d1c-6539bedca469 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.671319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-86e49943-4c74-44c1-8d1c-6539bedca469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.686571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e49943-4c74-44c1-8d1c-6539bedca469 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.691423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.692132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.692329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.692603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] PATH_INFO: `/v3/projects/2b09c99b982143cb803864193ddbb891` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.693720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b09c99b982143cb803864193ddbb891)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.695739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.711630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece7040f8ae648728cd40ce098135fc3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.718807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece7040f8ae648728cd40ce098135fc3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.719514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece7040f8ae648728cd40ce098135fc3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.735474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece7040f8ae648728cd40ce098135fc3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.736247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece7040f8ae648728cd40ce098135fc3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.747810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b09c99b982143cb803864193ddbb891', 'request_id': 'req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.753407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1103/2231] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:31 2022] DELETE /identity/v3/users/ece7040f8ae648728cd40ce098135fc3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:31.754518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.755559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b09c99b982143cb803864193ddbb891', 'request_id': 'req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.756525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.764145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b09c99b982143cb803864193ddbb891', 'request_id': 'req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.773246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=80,keystone:DELETE=15,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:31.780299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] The token cache is being invalidate because project 2b09c99b982143cb803864193ddbb891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:31.780643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.781388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.783300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1129/2232] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:31 2022] DELETE /identity/v3/projects/2b09c99b982143cb803864193ddbb891 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:31.783974 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:31.787069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.837812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8be9-2472-4c63-acef-0500d8fa1d21 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.845288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bf508-4792-4824-a6b2-3b961cd940ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.846139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bf508-4792-4824-a6b2-3b961cd940ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.846647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bf508-4792-4824-a6b2-3b961cd940ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.847059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bf508-4792-4824-a6b2-3b961cd940ba admin admin] PATH_INFO: `/v3/projects/f3206de788214512923c542d79388baa/users/04304710305b45e3bd3a4d720aa4c4d3/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.869568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bf508-4792-4824-a6b2-3b961cd940ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3206de788214512923c542d79388baa, user_id=04304710305b45e3bd3a4d720aa4c4d3, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.873549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bf508-4792-4824-a6b2-3b961cd940ba admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.873767 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9876d-ecf5-4cea-b2c8-e9e793306a63 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:31.879024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:31.879627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.879966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.880287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] PATH_INFO: `/v3/users/6f44f913c5b843018d5a984bd789f8b2` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.881552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f44f913c5b843018d5a984bd789f8b2)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:31.883789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:31.892211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1104/2233] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:31 2022] PUT /identity/v3/projects/f3206de788214512923c542d79388baa/users/04304710305b45e3bd3a4d720aa4c4d3/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:31.894281 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131612d5-3649-4fe3-ac27-804bc866d1ba None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:31.894858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131612d5-3649-4fe3-ac27-804bc866d1ba None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:31.895364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131612d5-3649-4fe3-ac27-804bc866d1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:31.929886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-131612d5-3649-4fe3-ac27-804bc866d1ba None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:31.931641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-131612d5-3649-4fe3-ac27-804bc866d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:31.982878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f44f913c5b843018d5a984bd789f8b2'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.984650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f44f913c5b843018d5a984bd789f8b2'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.985459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f44f913c5b843018d5a984bd789f8b2'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:31.987543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:32.000303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f44f913c5b843018d5a984bd789f8b2'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.013921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f44f913c5b843018d5a984bd789f8b2'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.028426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1105/2234] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:32.029682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2a2e3-361e-4d1c-ad97-2d3a21822ead None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:32.029971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2a2e3-361e-4d1c-ad97-2d3a21822ead None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:32.030243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2a2e3-361e-4d1c-ad97-2d3a21822ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:32.043053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1130/2235] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:31 2022] DELETE /identity/v3/users/6f44f913c5b843018d5a984bd789f8b2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:32.044168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:32.045575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:32.069766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-96f2a2e3-361e-4d1c-ad97-2d3a21822ead None None] MFA Rules not processed for user `04304710305b45e3bd3a4d720aa4c4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:32.071156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-96f2a2e3-361e-4d1c-ad97-2d3a21822ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:32.120129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fc358-13dc-4b5b-9960-58714ef28c31 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:32.130687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc38a-0cce-4e0f-9ccb-fd7ecd839b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:32.131344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc38a-0cce-4e0f-9ccb-fd7ecd839b65 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:32.131631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc38a-0cce-4e0f-9ccb-fd7ecd839b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:32.132483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc38a-0cce-4e0f-9ccb-fd7ecd839b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:32.149051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1106/2236] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:32.152709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64be6b-3ebd-4b4b-ae80-c4560c4eb989 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:32.152709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64be6b-3ebd-4b4b-ae80-c4560c4eb989 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:32.152709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64be6b-3ebd-4b4b-ae80-c4560c4eb989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:32.171075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-eb64be6b-3ebd-4b4b-ae80-c4560c4eb989 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:32.172874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-eb64be6b-3ebd-4b4b-ae80-c4560c4eb989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:32.192744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:32.202496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc38a-0cce-4e0f-9ccb-fd7ecd839b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:32.203996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc38a-0cce-4e0f-9ccb-fd7ecd839b65 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:32.213932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1131/2237] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:32.214748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc38a-0cce-4e0f-9ccb-fd7ecd839b65 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:32.216160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-59ccc38a-0cce-4e0f-9ccb-fd7ecd839b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:32.238441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1107/2238] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:32.254840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64be6b-3ebd-4b4b-ae80-c4560c4eb989 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:32.256995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-eb64be6b-3ebd-4b4b-ae80-c4560c4eb989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:32.278434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64be6b-3ebd-4b4b-ae80-c4560c4eb989 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:32.284051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e385e-8322-46fc-9333-591724bebef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:32.284844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e385e-8322-46fc-9333-591724bebef4 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:32.285336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e385e-8322-46fc-9333-591724bebef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:32.285832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e385e-8322-46fc-9333-591724bebef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:32.293784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc38a-0cce-4e0f-9ccb-fd7ecd839b65 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:32.298041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e385e-8322-46fc-9333-591724bebef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:32.298520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263928ec-a039-45f0-92c1-b6d7e614e207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:32.299249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263928ec-a039-45f0-92c1-b6d7e614e207 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:32.299644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263928ec-a039-45f0-92c1-b6d7e614e207 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:32.299847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e385e-8322-46fc-9333-591724bebef4 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:32.300017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263928ec-a039-45f0-92c1-b6d7e614e207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:32.314571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263928ec-a039-45f0-92c1-b6d7e614e207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:32.316175 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263928ec-a039-45f0-92c1-b6d7e614e207 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:32.323532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1108/2239] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:47:32.330823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1132/2240] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:32.634892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e385e-8322-46fc-9333-591724bebef4 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:32.636344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e08e385e-8322-46fc-9333-591724bebef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:32.657785 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e385e-8322-46fc-9333-591724bebef4 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:32.662261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:32.662942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:32.663858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:32.664135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] PATH_INFO: `/v3/projects/735da6582cd24f299ffc0e9523728560` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:32.665317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735da6582cd24f299ffc0e9523728560)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:32.667365 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:32.727243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735da6582cd24f299ffc0e9523728560', 'request_id': 'req-14475c2a-1162-4b20-a2b7-a2099a698939'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.736956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735da6582cd24f299ffc0e9523728560', 'request_id': 'req-14475c2a-1162-4b20-a2b7-a2099a698939'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.744825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735da6582cd24f299ffc0e9523728560', 'request_id': 'req-14475c2a-1162-4b20-a2b7-a2099a698939'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.759627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] The token cache is being invalidate because project 735da6582cd24f299ffc0e9523728560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:32.760064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.760949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.762585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1109/2241] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:32 2022] DELETE /identity/v3/projects/735da6582cd24f299ffc0e9523728560 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:32.771455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263928ec-a039-45f0-92c1-b6d7e614e207 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:32.783528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263928ec-a039-45f0-92c1-b6d7e614e207 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:32.802566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:32.811697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:32.813550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:32.874921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:32.875502 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:32.875782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:32.876060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] PATH_INFO: `/v3/users/2ad13a7d17ca46c7ae53d03fc2692f6e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:32.877924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad13a7d17ca46c7ae53d03fc2692f6e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:32.879907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:32.918276 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475c2a-1162-4b20-a2b7-a2099a698939 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:32.925977 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:32.927148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:32.927572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:32.928147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] PATH_INFO: `/v3/projects/a9c97f12b1514f5e96e6c0cc8c3c577e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:32.930953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c97f12b1514f5e96e6c0cc8c3c577e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:32.933504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:32.957344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad13a7d17ca46c7ae53d03fc2692f6e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.958163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad13a7d17ca46c7ae53d03fc2692f6e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.958890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad13a7d17ca46c7ae53d03fc2692f6e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.967736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad13a7d17ca46c7ae53d03fc2692f6e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.976625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad13a7d17ca46c7ae53d03fc2692f6e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:32.988824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:33.006068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1133/2242] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:32 2022] DELETE /identity/v3/users/2ad13a7d17ca46c7ae53d03fc2692f6e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:33.008721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c97f12b1514f5e96e6c0cc8c3c577e', 'request_id': 'req-3c70554e-e7b3-45d8-a176-f69604ce59e0'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.018116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c97f12b1514f5e96e6c0cc8c3c577e', 'request_id': 'req-3c70554e-e7b3-45d8-a176-f69604ce59e0'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.027871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c97f12b1514f5e96e6c0cc8c3c577e', 'request_id': 'req-3c70554e-e7b3-45d8-a176-f69604ce59e0'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.041225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] The token cache is being invalidate because project a9c97f12b1514f5e96e6c0cc8c3c577e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:33.041662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.042434 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3c70554e-e7b3-45d8-a176-f69604ce59e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.044086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1110/2243] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:32 2022] DELETE /identity/v3/projects/a9c97f12b1514f5e96e6c0cc8c3c577e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:33.451861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:33.454920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:33.539927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aa96f-81fe-448c-816c-716e9bb0fcd7 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:33.544677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:33.545325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:33.545601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:33.545877 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] PATH_INFO: `/v3/projects/59825ba04ce347928c945d6eb1236b1b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:33.547060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59825ba04ce347928c945d6eb1236b1b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:33.549021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:33.595370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:33.605149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59825ba04ce347928c945d6eb1236b1b', 'request_id': 'req-f836d9f6-4532-4f1e-8407-1636ff9ce510'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.615481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59825ba04ce347928c945d6eb1236b1b', 'request_id': 'req-f836d9f6-4532-4f1e-8407-1636ff9ce510'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.622359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59825ba04ce347928c945d6eb1236b1b', 'request_id': 'req-f836d9f6-4532-4f1e-8407-1636ff9ce510'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.638698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] The token cache is being invalidate because project 59825ba04ce347928c945d6eb1236b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:33.639238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.639915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f836d9f6-4532-4f1e-8407-1636ff9ce510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:33.641804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1134/2244] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:33 2022] DELETE /identity/v3/projects/59825ba04ce347928c945d6eb1236b1b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:33.646679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb326d-1e86-469b-9f54-39568a025d6f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:33.647208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb326d-1e86-469b-9f54-39568a025d6f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:33.647894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb326d-1e86-469b-9f54-39568a025d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:33.671451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b2cb326d-1e86-469b-9f54-39568a025d6f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:33.672705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b2cb326d-1e86-469b-9f54-39568a025d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:33.750523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1111/2245] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:33.827593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ccae9-952d-475b-a1b2-14a73302b27e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:33.828255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ccae9-952d-475b-a1b2-14a73302b27e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:33.828255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ccae9-952d-475b-a1b2-14a73302b27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:33.853584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-513ccae9-952d-475b-a1b2-14a73302b27e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:33.854878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-513ccae9-952d-475b-a1b2-14a73302b27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:33.864695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1135/2246] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:33.869507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb326d-1e86-469b-9f54-39568a025d6f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:33.880411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb326d-1e86-469b-9f54-39568a025d6f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:33.886266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c340-883b-4cc5-bca8-16e898802329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:33.887003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c340-883b-4cc5-bca8-16e898802329 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:33.887431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c340-883b-4cc5-bca8-16e898802329 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:33.887828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c340-883b-4cc5-bca8-16e898802329 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:33.888621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361c340-883b-4cc5-bca8-16e898802329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:33.888930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361c340-883b-4cc5-bca8-16e898802329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:33.890601 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361c340-883b-4cc5-bca8-16e898802329 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:33.904861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1112/2247] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:47:33.910138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ccae9-952d-475b-a1b2-14a73302b27e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:33.934846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ccae9-952d-475b-a1b2-14a73302b27e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:33.946388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3111-58a6-4c6c-9205-95e2fbe31263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:33.947432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3111-58a6-4c6c-9205-95e2fbe31263 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:33.948051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3111-58a6-4c6c-9205-95e2fbe31263 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:33.948412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3111-58a6-4c6c-9205-95e2fbe31263 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:33.949219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb3111-58a6-4c6c-9205-95e2fbe31263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:33.953259 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb3111-58a6-4c6c-9205-95e2fbe31263 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:33.994635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1136/2248] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:33 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:33.996291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c340-883b-4cc5-bca8-16e898802329 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:34.007937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c340-883b-4cc5-bca8-16e898802329 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:34.090531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bc9e1-8049-47ed-ae48-1faf6932df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:34.091187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bc9e1-8049-47ed-ae48-1faf6932df6e admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:34.091454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bc9e1-8049-47ed-ae48-1faf6932df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:34.091733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bc9e1-8049-47ed-ae48-1faf6932df6e admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:34.092393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bc9e1-8049-47ed-ae48-1faf6932df6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:34.094337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bc9e1-8049-47ed-ae48-1faf6932df6e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:34.119077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1113/2249] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:33 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:34.120290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3111-58a6-4c6c-9205-95e2fbe31263 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:34.131073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3111-58a6-4c6c-9205-95e2fbe31263 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:34.136437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579a87b-3c0c-4edc-a23e-278f6fa63840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:34.137039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a87b-3c0c-4edc-a23e-278f6fa63840 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:34.137314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a87b-3c0c-4edc-a23e-278f6fa63840 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:34.137584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a87b-3c0c-4edc-a23e-278f6fa63840 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:34.138221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579a87b-3c0c-4edc-a23e-278f6fa63840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:34.139849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579a87b-3c0c-4edc-a23e-278f6fa63840 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:34.150251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1137/2250] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:34.154329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bc9e1-8049-47ed-ae48-1faf6932df6e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:34.164554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bc9e1-8049-47ed-ae48-1faf6932df6e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:34.169309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959e3e8-b9eb-41a3-bd38-78acc875521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:34.169911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959e3e8-b9eb-41a3-bd38-78acc875521f admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:34.170193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959e3e8-b9eb-41a3-bd38-78acc875521f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:34.170477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959e3e8-b9eb-41a3-bd38-78acc875521f admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:34.171193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959e3e8-b9eb-41a3-bd38-78acc875521f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:34.172797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959e3e8-b9eb-41a3-bd38-78acc875521f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:34.184211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1114/2251] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:34.188328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579a87b-3c0c-4edc-a23e-278f6fa63840 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:34.199231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579a87b-3c0c-4edc-a23e-278f6fa63840 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:34.203881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664c114-2083-43f5-b952-b47296f9a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:34.204525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664c114-2083-43f5-b952-b47296f9a8be admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:34.204803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664c114-2083-43f5-b952-b47296f9a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:34.205099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664c114-2083-43f5-b952-b47296f9a8be admin admin] PATH_INFO: `/v3/projects/e2a5cd706e1542f18ab42558abe2f3a9/users/dd2e1da662734ca69e30a3d76b1d0dcd/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:34.220614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664c114-2083-43f5-b952-b47296f9a8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a5cd706e1542f18ab42558abe2f3a9, user_id=dd2e1da662734ca69e30a3d76b1d0dcd, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:34.223297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664c114-2083-43f5-b952-b47296f9a8be admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:34.237307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1138/2252] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:34 2022] PUT /identity/v3/projects/e2a5cd706e1542f18ab42558abe2f3a9/users/dd2e1da662734ca69e30a3d76b1d0dcd/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:34.243011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b51db-0748-47ec-bfa9-5bdf8c715700 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:34.243300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b51db-0748-47ec-bfa9-5bdf8c715700 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:34.243575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b51db-0748-47ec-bfa9-5bdf8c715700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:34.264933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-503b51db-0748-47ec-bfa9-5bdf8c715700 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:34.266204 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-503b51db-0748-47ec-bfa9-5bdf8c715700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:34.296010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:34.336362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1115/2253] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:34.346339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664c114-2083-43f5-b952-b47296f9a8be admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:34.348171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8664c114-2083-43f5-b952-b47296f9a8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:34.407185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664c114-2083-43f5-b952-b47296f9a8be admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:34.410844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f76d78-ea6f-47bd-8f77-722dbea646c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:34.411460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f76d78-ea6f-47bd-8f77-722dbea646c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:34.411743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f76d78-ea6f-47bd-8f77-722dbea646c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:34.412021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f76d78-ea6f-47bd-8f77-722dbea646c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:34.422030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f76d78-ea6f-47bd-8f77-722dbea646c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:34.423431 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f76d78-ea6f-47bd-8f77-722dbea646c3 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:34.433853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1139/2254] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:35.056465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dbcfd-eba5-451e-b8d1-9c25092e5333 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:35.057010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dbcfd-eba5-451e-b8d1-9c25092e5333 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:35.057115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dbcfd-eba5-451e-b8d1-9c25092e5333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:35.122628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3d8dbcfd-eba5-451e-b8d1-9c25092e5333 None None] MFA Rules not processed for user `dd2e1da662734ca69e30a3d76b1d0dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:35.123761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3d8dbcfd-eba5-451e-b8d1-9c25092e5333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:35.213597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1116/2255] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:35.218310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f76d78-ea6f-47bd-8f77-722dbea646c3 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:35.230047 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f76d78-ea6f-47bd-8f77-722dbea646c3 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:35.234987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee919a5-e4ab-4a98-a7a0-9631a037489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:35.235491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee919a5-e4ab-4a98-a7a0-9631a037489b admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:35.235777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee919a5-e4ab-4a98-a7a0-9631a037489b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:35.236078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee919a5-e4ab-4a98-a7a0-9631a037489b admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:35.236815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee919a5-e4ab-4a98-a7a0-9631a037489b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:35.239400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee919a5-e4ab-4a98-a7a0-9631a037489b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:35.284718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1140/2256] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:35 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:35.286725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dbcfd-eba5-451e-b8d1-9c25092e5333 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:35.304872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dbcfd-eba5-451e-b8d1-9c25092e5333 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:35.375652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf88062-db86-4f28-b2b4-bd92b8d12b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:35.376305 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf88062-db86-4f28-b2b4-bd92b8d12b80 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:35.376919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf88062-db86-4f28-b2b4-bd92b8d12b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:35.376919 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf88062-db86-4f28-b2b4-bd92b8d12b80 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:35.377453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf88062-db86-4f28-b2b4-bd92b8d12b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:35.379426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf88062-db86-4f28-b2b4-bd92b8d12b80 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:35.422380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1117/2257] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:35 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:35.423818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee919a5-e4ab-4a98-a7a0-9631a037489b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:35.435939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee919a5-e4ab-4a98-a7a0-9631a037489b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:35.444341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ff97-74b9-490f-9b39-7c843833a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:35.445472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ff97-74b9-490f-9b39-7c843833a419 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:35.445760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ff97-74b9-490f-9b39-7c843833a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:35.446043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ff97-74b9-490f-9b39-7c843833a419 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:35.446884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1ff97-74b9-490f-9b39-7c843833a419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:35.449161 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1ff97-74b9-490f-9b39-7c843833a419 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:35.474815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1141/2258] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:47:35.480184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf88062-db86-4f28-b2b4-bd92b8d12b80 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:35.493445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf88062-db86-4f28-b2b4-bd92b8d12b80 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:35.498576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451d5fd-dd04-40b3-9224-a8cdf4634751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:35.499379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451d5fd-dd04-40b3-9224-a8cdf4634751 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:35.499772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451d5fd-dd04-40b3-9224-a8cdf4634751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:35.500166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451d5fd-dd04-40b3-9224-a8cdf4634751 admin admin] PATH_INFO: `/v3/projects/f16fcafc384248dd82781cfc43eaff92/users/0a39a4ea5a3549ff917de0fc45d2b613/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:35.521198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451d5fd-dd04-40b3-9224-a8cdf4634751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16fcafc384248dd82781cfc43eaff92, user_id=0a39a4ea5a3549ff917de0fc45d2b613, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:35.526833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451d5fd-dd04-40b3-9224-a8cdf4634751 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:35.552325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1118/2259] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:35 2022] PUT /identity/v3/projects/f16fcafc384248dd82781cfc43eaff92/users/0a39a4ea5a3549ff917de0fc45d2b613/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:35.552966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ff97-74b9-490f-9b39-7c843833a419 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:35.565727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ff97-74b9-490f-9b39-7c843833a419 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:35.618631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:35.669472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0959e5f-be32-4232-b5ec-e48b3a1fc964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:35.670108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959e5f-be32-4232-b5ec-e48b3a1fc964 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:35.670394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959e5f-be32-4232-b5ec-e48b3a1fc964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:35.670673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959e5f-be32-4232-b5ec-e48b3a1fc964 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:35.671372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0959e5f-be32-4232-b5ec-e48b3a1fc964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:35.673040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0959e5f-be32-4232-b5ec-e48b3a1fc964 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:35.686173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1142/2260] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:35.690706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451d5fd-dd04-40b3-9224-a8cdf4634751 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:35.703308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451d5fd-dd04-40b3-9224-a8cdf4634751 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:35.711161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691df82-b3d4-4796-92da-b8129bfb99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:35.711984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691df82-b3d4-4796-92da-b8129bfb99f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:35.712332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691df82-b3d4-4796-92da-b8129bfb99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:35.712678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691df82-b3d4-4796-92da-b8129bfb99f0 admin admin] PATH_INFO: `/v3/projects/f16fcafc384248dd82781cfc43eaff92/users/0a39a4ea5a3549ff917de0fc45d2b613/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:35.714857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691df82-b3d4-4796-92da-b8129bfb99f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16fcafc384248dd82781cfc43eaff92, user_id=0a39a4ea5a3549ff917de0fc45d2b613, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:35.717485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691df82-b3d4-4796-92da-b8129bfb99f0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:35.734131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1119/2261] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:35 2022] PUT /identity/v3/projects/f16fcafc384248dd82781cfc43eaff92/users/0a39a4ea5a3549ff917de0fc45d2b613/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:47:36.391284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688482c-dd64-4a12-a4aa-8d6feace812a None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:36.391811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688482c-dd64-4a12-a4aa-8d6feace812a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:36.391811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688482c-dd64-4a12-a4aa-8d6feace812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:36.424899 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4688482c-dd64-4a12-a4aa-8d6feace812a None None] MFA Rules not processed for user `0a39a4ea5a3549ff917de0fc45d2b613`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:36.426149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4688482c-dd64-4a12-a4aa-8d6feace812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:36.503891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1143/2262] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:36.515488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c2b58-7669-4b13-bf2a-5692593997b5 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:36.516005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c2b58-7669-4b13-bf2a-5692593997b5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:36.516167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c2b58-7669-4b13-bf2a-5692593997b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:36.536615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-bd8c2b58-7669-4b13-bf2a-5692593997b5 None None] MFA Rules not processed for user `dd2e1da662734ca69e30a3d76b1d0dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:36.537853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bd8c2b58-7669-4b13-bf2a-5692593997b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:36.547622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:36.601049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1120/2263] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:36.611762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688482c-dd64-4a12-a4aa-8d6feace812a None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:36.613160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4688482c-dd64-4a12-a4aa-8d6feace812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:36.692340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688482c-dd64-4a12-a4aa-8d6feace812a None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:36.699300 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ede35-2544-4eda-aadb-bb47197e7b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:36.700235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ede35-2544-4eda-aadb-bb47197e7b75 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:36.700671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ede35-2544-4eda-aadb-bb47197e7b75 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:36.701097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ede35-2544-4eda-aadb-bb47197e7b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:36.710933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ede35-2544-4eda-aadb-bb47197e7b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:36.712598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ede35-2544-4eda-aadb-bb47197e7b75 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:36.722238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1144/2264] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:37.966975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c2b58-7669-4b13-bf2a-5692593997b5 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:37.968476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bd8c2b58-7669-4b13-bf2a-5692593997b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:38.035646 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c2b58-7669-4b13-bf2a-5692593997b5 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:38.040566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:38.041203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:38.041511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:38.041787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] PATH_INFO: `/v3/users/04304710305b45e3bd3a4d720aa4c4d3` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:38.042941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=04304710305b45e3bd3a4d720aa4c4d3)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:38.044869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:38.090114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04304710305b45e3bd3a4d720aa4c4d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:38.097575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04304710305b45e3bd3a4d720aa4c4d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:38.098236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04304710305b45e3bd3a4d720aa4c4d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:38.110397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04304710305b45e3bd3a4d720aa4c4d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:38.111077 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04304710305b45e3bd3a4d720aa4c4d3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:38.124702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1121/2265] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:47:37 2022] DELETE /identity/v3/users/04304710305b45e3bd3a4d720aa4c4d3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:38.129301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4fa40-826d-426a-823d-fd360c532d3b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:38.129754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4fa40-826d-426a-823d-fd360c532d3b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:38.129865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4fa40-826d-426a-823d-fd360c532d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:38.150144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c9e4fa40-826d-426a-823d-fd360c532d3b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:38.151403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c9e4fa40-826d-426a-823d-fd360c532d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:38.186676 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:38.214914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1145/2266] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:38.226876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:38.228409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:38.276641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:38.298717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e553c57-c1d8-49f9-ac6f-5d81d47802bc admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:38.302575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445612c9-c5fb-432c-ae2d-c6d49586dfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:38.303455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445612c9-c5fb-432c-ae2d-c6d49586dfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:38.304928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445612c9-c5fb-432c-ae2d-c6d49586dfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:38.305223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445612c9-c5fb-432c-ae2d-c6d49586dfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:38.317245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445612c9-c5fb-432c-ae2d-c6d49586dfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:38.318714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445612c9-c5fb-432c-ae2d-c6d49586dfd7 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:38.330469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1122/2267] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:38.993992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4fa40-826d-426a-823d-fd360c532d3b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:38.995486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c9e4fa40-826d-426a-823d-fd360c532d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:39.012892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4fa40-826d-426a-823d-fd360c532d3b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:39.019729 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:39.020587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.021158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.021448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] PATH_INFO: `/v3/projects/f3206de788214512923c542d79388baa` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.023420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3206de788214512923c542d79388baa)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:39.025360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:39.085207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3206de788214512923c542d79388baa', 'request_id': 'req-591bde7d-d929-41b4-b720-060ee680e5d1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:39.092934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3206de788214512923c542d79388baa', 'request_id': 'req-591bde7d-d929-41b4-b720-060ee680e5d1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:39.099949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3206de788214512923c542d79388baa', 'request_id': 'req-591bde7d-d929-41b4-b720-060ee680e5d1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:39.116334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] The token cache is being invalidate because project f3206de788214512923c542d79388baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:47:39.116973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:39.117830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-591bde7d-d929-41b4-b720-060ee680e5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:47:39.119483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1146/2268] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:47:38 2022] DELETE /identity/v3/projects/f3206de788214512923c542d79388baa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:39.124620 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62243ac2-ee5e-42e6-b6cf-6755c5f316a3 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.125109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62243ac2-ee5e-42e6-b6cf-6755c5f316a3 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.125301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62243ac2-ee5e-42e6-b6cf-6755c5f316a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.146259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-62243ac2-ee5e-42e6-b6cf-6755c5f316a3 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:39.147879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-62243ac2-ee5e-42e6-b6cf-6755c5f316a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:39.226895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1123/2269] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:39.235196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d8ab4-74d8-41a2-b23d-bf713636a2f5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.235661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d8ab4-74d8-41a2-b23d-bf713636a2f5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.235886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d8ab4-74d8-41a2-b23d-bf713636a2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.258285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-8a4d8ab4-74d8-41a2-b23d-bf713636a2f5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:39.259827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8a4d8ab4-74d8-41a2-b23d-bf713636a2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:39.269468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1147/2270] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:39.274010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62243ac2-ee5e-42e6-b6cf-6755c5f316a3 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:39.284655 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62243ac2-ee5e-42e6-b6cf-6755c5f316a3 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:39.289658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506636b-03f3-4118-a3a1-e06862112e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:39.290590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506636b-03f3-4118-a3a1-e06862112e52 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.290875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506636b-03f3-4118-a3a1-e06862112e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.291153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506636b-03f3-4118-a3a1-e06862112e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.291805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506636b-03f3-4118-a3a1-e06862112e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:47:39.292109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506636b-03f3-4118-a3a1-e06862112e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:39.293708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506636b-03f3-4118-a3a1-e06862112e52 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:39.307396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1124/2271] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:47:39.311909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d8ab4-74d8-41a2-b23d-bf713636a2f5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:39.325599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d8ab4-74d8-41a2-b23d-bf713636a2f5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:39.332354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716f661-3907-4a72-8b1f-c63fbd6cf895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:39.333503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716f661-3907-4a72-8b1f-c63fbd6cf895 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.333831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716f661-3907-4a72-8b1f-c63fbd6cf895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.334119 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716f661-3907-4a72-8b1f-c63fbd6cf895 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.334975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716f661-3907-4a72-8b1f-c63fbd6cf895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:39.343886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716f661-3907-4a72-8b1f-c63fbd6cf895 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:39.380152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1148/2272] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:47:39 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:39.384877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506636b-03f3-4118-a3a1-e06862112e52 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:39.395288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506636b-03f3-4118-a3a1-e06862112e52 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:39.456256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78763a0b-e167-4a5f-b257-6185b5a1a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:39.457022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78763a0b-e167-4a5f-b257-6185b5a1a949 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.457846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78763a0b-e167-4a5f-b257-6185b5a1a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.457846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78763a0b-e167-4a5f-b257-6185b5a1a949 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.458408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78763a0b-e167-4a5f-b257-6185b5a1a949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:39.460704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78763a0b-e167-4a5f-b257-6185b5a1a949 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:39.485519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1125/2273] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:47:39 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:47:39.491697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716f661-3907-4a72-8b1f-c63fbd6cf895 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:39.502411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716f661-3907-4a72-8b1f-c63fbd6cf895 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:39.508098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a8bf-87a5-42a4-a98f-57ad9c80aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:39.508704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a8bf-87a5-42a4-a98f-57ad9c80aec6 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.508980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a8bf-87a5-42a4-a98f-57ad9c80aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.509250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a8bf-87a5-42a4-a98f-57ad9c80aec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.509885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a8bf-87a5-42a4-a98f-57ad9c80aec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:39.511529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a8bf-87a5-42a4-a98f-57ad9c80aec6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:39.522705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1149/2274] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:39.527165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78763a0b-e167-4a5f-b257-6185b5a1a949 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:39.537566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78763a0b-e167-4a5f-b257-6185b5a1a949 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:39.542362 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bc3cb-fe11-4331-8c16-7dfcb05ab2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:39.542992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bc3cb-fe11-4331-8c16-7dfcb05ab2df admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.543287 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bc3cb-fe11-4331-8c16-7dfcb05ab2df admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.543567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bc3cb-fe11-4331-8c16-7dfcb05ab2df admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.544195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bc3cb-fe11-4331-8c16-7dfcb05ab2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:39.545784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bc3cb-fe11-4331-8c16-7dfcb05ab2df admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:39.560289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1126/2275] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:47:39.561544 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a8bf-87a5-42a4-a98f-57ad9c80aec6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:39.572653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a8bf-87a5-42a4-a98f-57ad9c80aec6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:39.578030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664063b-8036-42ed-a109-665184489364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:39.578686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664063b-8036-42ed-a109-665184489364 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.579000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664063b-8036-42ed-a109-665184489364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.579274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664063b-8036-42ed-a109-665184489364 admin admin] PATH_INFO: `/v3/projects/2982201a1d644da4820637c9323528bf/users/c402f1668cdc4665ba056032f3129646/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.594260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664063b-8036-42ed-a109-665184489364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2982201a1d644da4820637c9323528bf, user_id=c402f1668cdc4665ba056032f3129646, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:39.597178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664063b-8036-42ed-a109-665184489364 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:39.612394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1150/2276] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:47:39 2022] PUT /identity/v3/projects/2982201a1d644da4820637c9323528bf/users/c402f1668cdc4665ba056032f3129646/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:47:39.620656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5e528-b506-4731-af21-65678ab4621d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.621112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5e528-b506-4731-af21-65678ab4621d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.621558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5e528-b506-4731-af21-65678ab4621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.653027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-0cd5e528-b506-4731-af21-65678ab4621d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:39.655117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-0cd5e528-b506-4731-af21-65678ab4621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:39.738897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:39.777422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1127/2277] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:39.791341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664063b-8036-42ed-a109-665184489364 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:39.794009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4664063b-8036-42ed-a109-665184489364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:39.861765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664063b-8036-42ed-a109-665184489364 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:39.865914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363f52b-4612-4b11-9e36-5408772d3d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:39.866942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363f52b-4612-4b11-9e36-5408772d3d53 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:39.867277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363f52b-4612-4b11-9e36-5408772d3d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:39.867586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363f52b-4612-4b11-9e36-5408772d3d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:39.878500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363f52b-4612-4b11-9e36-5408772d3d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:39.879776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363f52b-4612-4b11-9e36-5408772d3d53 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:39.892500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1151/2278] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:41.172026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb992b-eb8c-4aea-8fda-d39602a14ec3 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:41.172546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb992b-eb8c-4aea-8fda-d39602a14ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:41.172784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb992b-eb8c-4aea-8fda-d39602a14ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:41.212415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-abeb992b-eb8c-4aea-8fda-d39602a14ec3 None None] MFA Rules not processed for user `c402f1668cdc4665ba056032f3129646`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:41.213875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-abeb992b-eb8c-4aea-8fda-d39602a14ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:41.284339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1128/2279] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:47:41.297024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363f52b-4612-4b11-9e36-5408772d3d53 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:41.298563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e363f52b-4612-4b11-9e36-5408772d3d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:41.305760 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:41.363371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363f52b-4612-4b11-9e36-5408772d3d53 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:41.368766 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7234de-7647-4aad-ac05-ded32e6d9fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:41.369524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7234de-7647-4aad-ac05-ded32e6d9fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:41.369931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7234de-7647-4aad-ac05-ded32e6d9fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:41.370428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7234de-7647-4aad-ac05-ded32e6d9fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:41.380082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7234de-7647-4aad-ac05-ded32e6d9fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:41.382479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7234de-7647-4aad-ac05-ded32e6d9fa9 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:41.393310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1152/2280] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:42.780847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670027f3-13ec-460f-9a3d-4bc055fe8b12 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:42.781855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670027f3-13ec-460f-9a3d-4bc055fe8b12 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:42.781855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670027f3-13ec-460f-9a3d-4bc055fe8b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:42.802202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-670027f3-13ec-460f-9a3d-4bc055fe8b12 None None] MFA Rules not processed for user `c402f1668cdc4665ba056032f3129646`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:47:42.804237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-670027f3-13ec-460f-9a3d-4bc055fe8b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:42.813104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1129/2281] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:47:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:47:51.387938 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=25 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:52.432930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7234de-7647-4aad-ac05-ded32e6d9fa9 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:47:52.458414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7234de-7647-4aad-ac05-ded32e6d9fa9 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:47:52.468533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143429-ebe4-4d6a-9115-b8a5815854b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:47:52.469287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143429-ebe4-4d6a-9115-b8a5815854b9 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:47:52.470056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143429-ebe4-4d6a-9115-b8a5815854b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:47:52.471383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143429-ebe4-4d6a-9115-b8a5815854b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:47:52.473379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-54143429-ebe4-4d6a-9115-b8a5815854b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:47:52.632340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143429-ebe4-4d6a-9115-b8a5815854b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:47:52.634040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143429-ebe4-4d6a-9115-b8a5815854b9 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:47:52.650576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1153/2282] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:47:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:47:52.798722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=41 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:02.527665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3713-8f3d-427b-9573-380dbcfe3dbd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:02.529556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3713-8f3d-427b-9573-380dbcfe3dbd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:02.530070 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3713-8f3d-427b-9573-380dbcfe3dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:02.552743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-629a3713-8f3d-427b-9573-380dbcfe3dbd None None] MFA Rules not processed for user `a066d4114d3b438cacd7437966d17c66`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:02.554199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-629a3713-8f3d-427b-9573-380dbcfe3dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:02.634814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1130/2283] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:48:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:02.639930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=30 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:06.090226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55a1c6-3c78-4513-847d-43b9f64bdffc None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:06.102301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55a1c6-3c78-4513-847d-43b9f64bdffc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:06.102951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55a1c6-3c78-4513-847d-43b9f64bdffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:06.148229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-fe55a1c6-3c78-4513-847d-43b9f64bdffc None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:06.148229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-fe55a1c6-3c78-4513-847d-43b9f64bdffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:06.226423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1154/2284] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:48:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:06.245770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a3713-8f3d-427b-9573-380dbcfe3dbd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:06.248177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-629a3713-8f3d-427b-9573-380dbcfe3dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:06.351832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a3713-8f3d-427b-9573-380dbcfe3dbd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:06.358789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533442b-84a0-4c1d-9daa-0d80a5fc6fd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:06.359704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533442b-84a0-4c1d-9daa-0d80a5fc6fd9 service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:06.360203 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533442b-84a0-4c1d-9daa-0d80a5fc6fd9 service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:06.360696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533442b-84a0-4c1d-9daa-0d80a5fc6fd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:06.385083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533442b-84a0-4c1d-9daa-0d80a5fc6fd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:06.392999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533442b-84a0-4c1d-9daa-0d80a5fc6fd9 service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:06.417637 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1131/2285] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:48:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:48:08.363308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f645c-9dda-4417-b1e7-4f8dfff88254 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:08.363993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f645c-9dda-4417-b1e7-4f8dfff88254 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:08.364886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f645c-9dda-4417-b1e7-4f8dfff88254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:08.394553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9e2f645c-9dda-4417-b1e7-4f8dfff88254 None None] MFA Rules not processed for user `d9c69e18847a40379daf843e87dad68b`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:08.397212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9e2f645c-9dda-4417-b1e7-4f8dfff88254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:08.514905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1155/2286] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:48:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:16.400642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=57 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:18.494292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=50 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:19.441199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121d9c-6517-4fde-bb4c-9d21bbc19c41 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:19.441776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121d9c-6517-4fde-bb4c-9d21bbc19c41 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:19.441954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121d9c-6517-4fde-bb4c-9d21bbc19c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:19.477790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-28121d9c-6517-4fde-bb4c-9d21bbc19c41 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:19.488114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-28121d9c-6517-4fde-bb4c-9d21bbc19c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:19.513951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1132/2287] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:19.561672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f645c-9dda-4417-b1e7-4f8dfff88254 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:19.563800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9e2f645c-9dda-4417-b1e7-4f8dfff88254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:19.696858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f645c-9dda-4417-b1e7-4f8dfff88254 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:19.719679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ec1f0-dd31-47e8-9788-a3179bd37754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:19.720352 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ec1f0-dd31-47e8-9788-a3179bd37754 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:19.720637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ec1f0-dd31-47e8-9788-a3179bd37754 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:19.720911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ec1f0-dd31-47e8-9788-a3179bd37754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:19.736460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ec1f0-dd31-47e8-9788-a3179bd37754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:19.738169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ec1f0-dd31-47e8-9788-a3179bd37754 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:19.749634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1156/2288] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:19.868515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28121d9c-6517-4fde-bb4c-9d21bbc19c41 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:19.870589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-28121d9c-6517-4fde-bb4c-9d21bbc19c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:19.899301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28121d9c-6517-4fde-bb4c-9d21bbc19c41 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:19.906305 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:19.907711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:19.908988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:19.909520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] PATH_INFO: `/v3/users/dd2e1da662734ca69e30a3d76b1d0dcd` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:19.912059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2e1da662734ca69e30a3d76b1d0dcd)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:19.914890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:20.025526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2e1da662734ca69e30a3d76b1d0dcd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.033974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2e1da662734ca69e30a3d76b1d0dcd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.039179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2e1da662734ca69e30a3d76b1d0dcd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.053376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2e1da662734ca69e30a3d76b1d0dcd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.054103 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2e1da662734ca69e30a3d76b1d0dcd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.070137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1133/2289] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:48:19 2022] DELETE /identity/v3/users/dd2e1da662734ca69e30a3d76b1d0dcd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:48:20.359209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ec1f0-dd31-47e8-9788-a3179bd37754 service nova] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:20.372299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ec1f0-dd31-47e8-9788-a3179bd37754 service nova] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:20.480019 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:20.480845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:20.481127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:20.481419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] PATH_INFO: `/v3/projects/e2a5cd706e1542f18ab42558abe2f3a9` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:20.482534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a5cd706e1542f18ab42558abe2f3a9)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:20.484485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:20.535319 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a5cd706e1542f18ab42558abe2f3a9', 'request_id': 'req-d5a31c7e-c837-4784-b285-bedf96490116'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.542040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a5cd706e1542f18ab42558abe2f3a9', 'request_id': 'req-d5a31c7e-c837-4784-b285-bedf96490116'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.547870 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a5cd706e1542f18ab42558abe2f3a9', 'request_id': 'req-d5a31c7e-c837-4784-b285-bedf96490116'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.562533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] The token cache is being invalidate because project e2a5cd706e1542f18ab42558abe2f3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:48:20.563245 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.563463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.565198 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1157/2290] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:48:20 2022] DELETE /identity/v3/projects/e2a5cd706e1542f18ab42558abe2f3a9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:48:20.569801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:20.571288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:20.585878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a79ea-cfe8-4306-a7d1-07d6f38107e3 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:20.658712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:20.659530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:20.659903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:20.660303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] PATH_INFO: `/v3/users/0a39a4ea5a3549ff917de0fc45d2b613` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:20.661958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a39a4ea5a3549ff917de0fc45d2b613)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:20.664345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:20.713793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a39a4ea5a3549ff917de0fc45d2b613'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.721787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a39a4ea5a3549ff917de0fc45d2b613'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.722483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a39a4ea5a3549ff917de0fc45d2b613'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.734099 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:20.739682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a39a4ea5a3549ff917de0fc45d2b613'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.740973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c01ceabd-e15c-4147-b397-8db66c5f65b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a39a4ea5a3549ff917de0fc45d2b613'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:20.756803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1134/2291] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:48:20 2022] DELETE /identity/v3/users/0a39a4ea5a3549ff917de0fc45d2b613 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:48:21.030199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:21.031880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:21.045650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a31c7e-c837-4784-b285-bedf96490116 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:21.059856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:21.109654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:21.110683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:21.111088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:21.111452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] PATH_INFO: `/v3/projects/f16fcafc384248dd82781cfc43eaff92` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:21.112717 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16fcafc384248dd82781cfc43eaff92)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:21.115824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:21.174083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16fcafc384248dd82781cfc43eaff92', 'request_id': 'req-841e25fa-c2c6-474e-b44b-803f037aef82'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:21.181598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16fcafc384248dd82781cfc43eaff92', 'request_id': 'req-841e25fa-c2c6-474e-b44b-803f037aef82'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:21.187313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16fcafc384248dd82781cfc43eaff92', 'request_id': 'req-841e25fa-c2c6-474e-b44b-803f037aef82'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:21.208453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] The token cache is being invalidate because project f16fcafc384248dd82781cfc43eaff92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:48:21.208929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:21.209651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:48:21.211168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1158/2292] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:48:21 2022] DELETE /identity/v3/projects/f16fcafc384248dd82781cfc43eaff92 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:48:23.540626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08750dc1-541d-46ef-810e-ddebc01899b7 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:23.541149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08750dc1-541d-46ef-810e-ddebc01899b7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:23.541149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08750dc1-541d-46ef-810e-ddebc01899b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:23.562546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-08750dc1-541d-46ef-810e-ddebc01899b7 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:23.563891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-08750dc1-541d-46ef-810e-ddebc01899b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:23.629194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1135/2293] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:23.644141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:23.645777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:23.726453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e25fa-c2c6-474e-b44b-803f037aef82 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:23.731893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d606c3-496c-4ce1-9f8c-f14e8a4a0197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:23.732499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d606c3-496c-4ce1-9f8c-f14e8a4a0197 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:23.732775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d606c3-496c-4ce1-9f8c-f14e8a4a0197 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:23.733045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d606c3-496c-4ce1-9f8c-f14e8a4a0197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:23.741693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d606c3-496c-4ce1-9f8c-f14e8a4a0197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:23.743298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d606c3-496c-4ce1-9f8c-f14e8a4a0197 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:23.752524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1159/2294] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:27.837220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0502-7097-45d9-b031-294607851f5d None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:27.837870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0502-7097-45d9-b031-294607851f5d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:27.837870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0502-7097-45d9-b031-294607851f5d None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:27.839192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1136/2295] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:48:27.845174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9276f1-fcfd-41d2-8488-eef2ed8e9cdd None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:27.845668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9276f1-fcfd-41d2-8488-eef2ed8e9cdd None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:27.846080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9276f1-fcfd-41d2-8488-eef2ed8e9cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:27.867925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-1d9276f1-fcfd-41d2-8488-eef2ed8e9cdd None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:27.869489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1d9276f1-fcfd-41d2-8488-eef2ed8e9cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:27.880484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1160/2296] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:48:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:27.893850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a0502-7097-45d9-b031-294607851f5d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:27.896220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2d0a0502-7097-45d9-b031-294607851f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:28.021043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a0502-7097-45d9-b031-294607851f5d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:28.027895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d486b-7099-48f9-9080-60772433d4de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3bd33cac7d4715bede59def04cdb92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:28.028514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d486b-7099-48f9-9080-60772433d4de service glance] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:28.028841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d486b-7099-48f9-9080-60772433d4de service glance] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:28.029253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d486b-7099-48f9-9080-60772433d4de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:28.053867 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d486b-7099-48f9-9080-60772433d4de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:28.055382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d486b-7099-48f9-9080-60772433d4de service glance] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:28.071174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1137/2297] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:28.146386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a8790-3c5f-42ee-969c-2cc0968cd0ee None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:28.146754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a8790-3c5f-42ee-969c-2cc0968cd0ee None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:28.148903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a8790-3c5f-42ee-969c-2cc0968cd0ee None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:28.148903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1161/2298] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:48:28.154160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfa57-b277-4ab6-9497-9436f75e97eb None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:28.154455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfa57-b277-4ab6-9497-9436f75e97eb None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:28.154736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfa57-b277-4ab6-9497-9436f75e97eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:28.179926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-50ddfa57-b277-4ab6-9497-9436f75e97eb None None] MFA Rules not processed for user `9b072d5669e34ad5b7b52a4a6e26700b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:28.182274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-50ddfa57-b277-4ab6-9497-9436f75e97eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:28.236689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1138/2299] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:48:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:28.249394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a8790-3c5f-42ee-969c-2cc0968cd0ee None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:28.251178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d97a8790-3c5f-42ee-969c-2cc0968cd0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:28.265364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a8790-3c5f-42ee-969c-2cc0968cd0ee None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:28.269180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf864408-bdf5-4fb9-93b7-93ea9f512407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:28.269865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf864408-bdf5-4fb9-93b7-93ea9f512407 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:28.270619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf864408-bdf5-4fb9-93b7-93ea9f512407 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:28.270945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf864408-bdf5-4fb9-93b7-93ea9f512407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:28.277965 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf864408-bdf5-4fb9-93b7-93ea9f512407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:28.279434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf864408-bdf5-4fb9-93b7-93ea9f512407 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:28.288247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1162/2300] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:28.372532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b9ee1-83a5-4b07-868b-dcf9030095bb None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:28.372821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b9ee1-83a5-4b07-868b-dcf9030095bb None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:28.373253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b9ee1-83a5-4b07-868b-dcf9030095bb None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:28.374543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1139/2301] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:48:28.382345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6b3c-b21d-4f12-b560-a8a370d884ab None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:28.382345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6b3c-b21d-4f12-b560-a8a370d884ab None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:28.382566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6b3c-b21d-4f12-b560-a8a370d884ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:28.402522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-e4cd6b3c-b21d-4f12-b560-a8a370d884ab None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:28.403748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e4cd6b3c-b21d-4f12-b560-a8a370d884ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:28.413843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1163/2302] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:48:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:28.424500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b9ee1-83a5-4b07-868b-dcf9030095bb None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:28.436335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b9ee1-83a5-4b07-868b-dcf9030095bb None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:28.439951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b613b-3609-4234-bae8-52a79a64d917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:28.440547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b613b-3609-4234-bae8-52a79a64d917 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:28.440821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b613b-3609-4234-bae8-52a79a64d917 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:28.441088 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b613b-3609-4234-bae8-52a79a64d917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:28.455151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b613b-3609-4234-bae8-52a79a64d917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:28.456704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b613b-3609-4234-bae8-52a79a64d917 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:28.468481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1140/2303] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:28.903045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba28b6-f815-4b6f-9e4a-fb4911d4d949 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:28.903596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba28b6-f815-4b6f-9e4a-fb4911d4d949 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:28.903596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba28b6-f815-4b6f-9e4a-fb4911d4d949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:28.914242 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:28.928930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-acba28b6-f815-4b6f-9e4a-fb4911d4d949 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:28.930383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-acba28b6-f815-4b6f-9e4a-fb4911d4d949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:28.939430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1164/2304] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:28.957449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b613b-3609-4234-bae8-52a79a64d917 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:28.959278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e75b613b-3609-4234-bae8-52a79a64d917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:28.970100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:28.975210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b613b-3609-4234-bae8-52a79a64d917 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:28.983269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1db72-5a8b-43e6-aaba-ce4c19969e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:28.984032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1db72-5a8b-43e6-aaba-ce4c19969e09 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:28.984652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1db72-5a8b-43e6-aaba-ce4c19969e09 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:28.984924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1db72-5a8b-43e6-aaba-ce4c19969e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:28.994498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1db72-5a8b-43e6-aaba-ce4c19969e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:28.996161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1db72-5a8b-43e6-aaba-ce4c19969e09 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:29.007512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1141/2305] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:31.999807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb52b-c89a-4519-804b-1fefdaea8a2d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:32.000321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb52b-c89a-4519-804b-1fefdaea8a2d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:32.000419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb52b-c89a-4519-804b-1fefdaea8a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:32.020445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9a3bb52b-c89a-4519-804b-1fefdaea8a2d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:32.021637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9a3bb52b-c89a-4519-804b-1fefdaea8a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:32.035260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1165/2306] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:32.049839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1db72-5a8b-43e6-aaba-ce4c19969e09 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:32.061885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1db72-5a8b-43e6-aaba-ce4c19969e09 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:32.068207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eacf21-8db1-48e9-a068-cce5bc4fc9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:32.068789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eacf21-8db1-48e9-a068-cce5bc4fc9d2 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:32.069083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eacf21-8db1-48e9-a068-cce5bc4fc9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:32.069333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eacf21-8db1-48e9-a068-cce5bc4fc9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:32.077360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eacf21-8db1-48e9-a068-cce5bc4fc9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:32.078954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eacf21-8db1-48e9-a068-cce5bc4fc9d2 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:32.088547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1142/2307] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:34.924013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e328500-4933-49a3-b978-5a340ef409cf None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:34.924475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e328500-4933-49a3-b978-5a340ef409cf None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:34.924564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e328500-4933-49a3-b978-5a340ef409cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:34.950382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-1e328500-4933-49a3-b978-5a340ef409cf None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:34.951782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1e328500-4933-49a3-b978-5a340ef409cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:35.010800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1166/2308] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:35.024267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eacf21-8db1-48e9-a068-cce5bc4fc9d2 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:35.025732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-49eacf21-8db1-48e9-a068-cce5bc4fc9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:35.105963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eacf21-8db1-48e9-a068-cce5bc4fc9d2 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:35.111023 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7193664-378a-4a0a-95a4-54bd47ac0d4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:35.111630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7193664-378a-4a0a-95a4-54bd47ac0d4e service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:35.111906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7193664-378a-4a0a-95a4-54bd47ac0d4e service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:35.112179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7193664-378a-4a0a-95a4-54bd47ac0d4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:35.120489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7193664-378a-4a0a-95a4-54bd47ac0d4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:35.122066 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7193664-378a-4a0a-95a4-54bd47ac0d4e service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:35.130631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1143/2309] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:48:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:48:36.232663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f0d1-c64c-4ac7-9cae-aa23431f1df7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:36.233474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f0d1-c64c-4ac7-9cae-aa23431f1df7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:36.233902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f0d1-c64c-4ac7-9cae-aa23431f1df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:36.258123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b199f0d1-c64c-4ac7-9cae-aa23431f1df7 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:36.259411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b199f0d1-c64c-4ac7-9cae-aa23431f1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:36.267400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1167/2310] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:36.289280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7193664-378a-4a0a-95a4-54bd47ac0d4e service swift] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:36.304312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7193664-378a-4a0a-95a4-54bd47ac0d4e service swift] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:36.311555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8400f57-379f-42b0-997c-dbd9b97d6415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:36.312435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8400f57-379f-42b0-997c-dbd9b97d6415 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:36.312874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8400f57-379f-42b0-997c-dbd9b97d6415 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:36.313332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8400f57-379f-42b0-997c-dbd9b97d6415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:36.324410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8400f57-379f-42b0-997c-dbd9b97d6415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:36.325931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8400f57-379f-42b0-997c-dbd9b97d6415 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:36.340466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1144/2311] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:46.251911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=32 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:46.332331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=48 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:48:52.833732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a2cd-cf6c-409d-b26d-20676a6177ae None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:52.834273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a2cd-cf6c-409d-b26d-20676a6177ae None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:52.834379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a2cd-cf6c-409d-b26d-20676a6177ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:52.854427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-02c1a2cd-cf6c-409d-b26d-20676a6177ae None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:52.855671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-02c1a2cd-cf6c-409d-b26d-20676a6177ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:52.864015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1168/2312] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:48:52.880048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8400f57-379f-42b0-997c-dbd9b97d6415 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:52.891617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8400f57-379f-42b0-997c-dbd9b97d6415 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:52.898681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02861e-c59b-4561-a205-46b2c1cf37f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:52.899327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02861e-c59b-4561-a205-46b2c1cf37f6 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:52.899609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02861e-c59b-4561-a205-46b2c1cf37f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:52.899884 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02861e-c59b-4561-a205-46b2c1cf37f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:52.909043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02861e-c59b-4561-a205-46b2c1cf37f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:52.911503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02861e-c59b-4561-a205-46b2c1cf37f6 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:52.921438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1145/2313] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:56.288323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a2cd-cf6c-409d-b26d-20676a6177ae None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:56.291004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-02c1a2cd-cf6c-409d-b26d-20676a6177ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:56.317962 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166dc4-63a7-4279-b38e-7810cd8c48e3 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:56.318803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166dc4-63a7-4279-b38e-7810cd8c48e3 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:56.319086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166dc4-63a7-4279-b38e-7810cd8c48e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:56.339416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-86166dc4-63a7-4279-b38e-7810cd8c48e3 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:48:56.340722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-86166dc4-63a7-4279-b38e-7810cd8c48e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:56.348110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1146/2314] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 11:48:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:48:56.361027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86166dc4-63a7-4279-b38e-7810cd8c48e3 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:48:56.364970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a2cd-cf6c-409d-b26d-20676a6177ae None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:56.369950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658d175-072e-4894-96b3-f6138a768d88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:56.370560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658d175-072e-4894-96b3-f6138a768d88 service placement] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:56.370879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658d175-072e-4894-96b3-f6138a768d88 service placement] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:56.371132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658d175-072e-4894-96b3-f6138a768d88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:56.373147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e658d175-072e-4894-96b3-f6138a768d88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:48:56.373965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86166dc4-63a7-4279-b38e-7810cd8c48e3 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:48:56.379991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41de664-294c-4c3b-a9b1-683bb3ecd50b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:48:56.380507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41de664-294c-4c3b-a9b1-683bb3ecd50b service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:48:56.381425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41de664-294c-4c3b-a9b1-683bb3ecd50b service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:48:56.381425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41de664-294c-4c3b-a9b1-683bb3ecd50b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:48:56.385479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658d175-072e-4894-96b3-f6138a768d88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:56.387246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658d175-072e-4894-96b3-f6138a768d88 service placement] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:56.390229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41de664-294c-4c3b-a9b1-683bb3ecd50b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:48:56.392097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41de664-294c-4c3b-a9b1-683bb3ecd50b service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:48:56.398126 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1169/2315] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:48:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:48:56.403736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1147/2316] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:48:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:49:06.394082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=35 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:06.405299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=15 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:09.146637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2cb86-514b-44c2-aaf3-d67e63453ed3 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:09.147179 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2cb86-514b-44c2-aaf3-d67e63453ed3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:09.147441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2cb86-514b-44c2-aaf3-d67e63453ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:09.169208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a5a2cb86-514b-44c2-aaf3-d67e63453ed3 None None] MFA Rules not processed for user `c402f1668cdc4665ba056032f3129646`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:49:09.170439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a5a2cb86-514b-44c2-aaf3-d67e63453ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:49:09.253121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1170/2317] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:49:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:49:19.245260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=25 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:19.709923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df620ee6-7ee1-4b4b-8cc8-8a70f9f4789f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:19.710401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df620ee6-7ee1-4b4b-8cc8-8a70f9f4789f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:19.710489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df620ee6-7ee1-4b4b-8cc8-8a70f9f4789f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:19.730141 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-df620ee6-7ee1-4b4b-8cc8-8a70f9f4789f None None] MFA Rules not processed for user `a066d4114d3b438cacd7437966d17c66`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:49:19.731288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-df620ee6-7ee1-4b4b-8cc8-8a70f9f4789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:49:19.789423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1148/2318] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:49:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:49:24.961675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5064c-6855-44d6-b85f-b3c2b9420b75 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:24.962333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5064c-6855-44d6-b85f-b3c2b9420b75 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:24.962333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5064c-6855-44d6-b85f-b3c2b9420b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:24.982007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-82a5064c-6855-44d6-b85f-b3c2b9420b75 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:49:24.983265 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-82a5064c-6855-44d6-b85f-b3c2b9420b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:49:24.991313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1171/2319] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:49:25.007389 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df620ee6-7ee1-4b4b-8cc8-8a70f9f4789f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:49:25.021265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df620ee6-7ee1-4b4b-8cc8-8a70f9f4789f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:49:25.026792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7df53-5b6c-4185-990e-4b1affd84299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:49:25.027399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7df53-5b6c-4185-990e-4b1affd84299 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:25.027702 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7df53-5b6c-4185-990e-4b1affd84299 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:25.028175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7df53-5b6c-4185-990e-4b1affd84299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:25.038017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7df53-5b6c-4185-990e-4b1affd84299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:49:25.040050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7df53-5b6c-4185-990e-4b1affd84299 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:49:25.051909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1149/2320] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:49:28.253617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedc904-baa1-4fc8-9e6d-0cb5788528cd None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:28.254128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedc904-baa1-4fc8-9e6d-0cb5788528cd None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:28.254599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedc904-baa1-4fc8-9e6d-0cb5788528cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:28.275983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9aedc904-baa1-4fc8-9e6d-0cb5788528cd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:49:28.277283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9aedc904-baa1-4fc8-9e6d-0cb5788528cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:49:28.286029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1172/2321] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:49:28.301200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7df53-5b6c-4185-990e-4b1affd84299 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:49:28.312536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7df53-5b6c-4185-990e-4b1affd84299 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:49:28.319537 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c83d5-759e-4bbe-aa72-0ab8b8d05c61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:49:28.320150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c83d5-759e-4bbe-aa72-0ab8b8d05c61 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:28.320447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c83d5-759e-4bbe-aa72-0ab8b8d05c61 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:28.320708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c83d5-759e-4bbe-aa72-0ab8b8d05c61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:28.330510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c83d5-759e-4bbe-aa72-0ab8b8d05c61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:49:28.332247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c83d5-759e-4bbe-aa72-0ab8b8d05c61 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:49:28.343717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1150/2322] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:49:31.353125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a06fc2-f4f1-4b1c-bad8-14f203d6e58d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:31.353685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a06fc2-f4f1-4b1c-bad8-14f203d6e58d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:31.353685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a06fc2-f4f1-4b1c-bad8-14f203d6e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:31.373675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-58a06fc2-f4f1-4b1c-bad8-14f203d6e58d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:49:31.374930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-58a06fc2-f4f1-4b1c-bad8-14f203d6e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:49:31.383689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1173/2323] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:49:31.399213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c83d5-759e-4bbe-aa72-0ab8b8d05c61 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:49:31.411029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c83d5-759e-4bbe-aa72-0ab8b8d05c61 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:49:31.416543 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe2dac-2344-480f-be4c-e47482f01b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:49:31.417146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe2dac-2344-480f-be4c-e47482f01b39 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:31.417426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe2dac-2344-480f-be4c-e47482f01b39 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:31.417699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe2dac-2344-480f-be4c-e47482f01b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:31.426458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe2dac-2344-480f-be4c-e47482f01b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:49:31.428090 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe2dac-2344-480f-be4c-e47482f01b39 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:49:31.437535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1151/2324] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:49:35.579434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78caad7-7437-4eed-b082-2e7ff6f84197 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:35.579962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78caad7-7437-4eed-b082-2e7ff6f84197 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:35.579962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78caad7-7437-4eed-b082-2e7ff6f84197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:35.601738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b78caad7-7437-4eed-b082-2e7ff6f84197 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:49:35.603010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b78caad7-7437-4eed-b082-2e7ff6f84197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:49:35.612731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1174/2325] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:49:35.628496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe2dac-2344-480f-be4c-e47482f01b39 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:49:35.639909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe2dac-2344-480f-be4c-e47482f01b39 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:49:35.647052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f84551-4b12-4b0f-a121-ff3b81ee18d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:49:35.647726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f84551-4b12-4b0f-a121-ff3b81ee18d4 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:35.647949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f84551-4b12-4b0f-a121-ff3b81ee18d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:35.648219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f84551-4b12-4b0f-a121-ff3b81ee18d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:35.656947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f84551-4b12-4b0f-a121-ff3b81ee18d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:49:35.658885 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f84551-4b12-4b0f-a121-ff3b81ee18d4 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:49:35.671098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1152/2326] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:49:38.748929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d4c2a-d673-45ec-aa8e-a1918720635e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:38.749453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d4c2a-d673-45ec-aa8e-a1918720635e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:38.749453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d4c2a-d673-45ec-aa8e-a1918720635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:38.769458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-334d4c2a-d673-45ec-aa8e-a1918720635e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:49:38.770645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-334d4c2a-d673-45ec-aa8e-a1918720635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:49:38.778355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1175/2327] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 11:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:49:38.796270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f84551-4b12-4b0f-a121-ff3b81ee18d4 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:49:38.807766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f84551-4b12-4b0f-a121-ff3b81ee18d4 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:49:38.813253 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6e79-e3ee-4009-8b28-471d04c94ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:49:38.813900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6e79-e3ee-4009-8b28-471d04c94ae7 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:38.814179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6e79-e3ee-4009-8b28-471d04c94ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:38.814451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6e79-e3ee-4009-8b28-471d04c94ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:38.822829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6e79-e3ee-4009-8b28-471d04c94ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:49:38.824416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6e79-e3ee-4009-8b28-471d04c94ae7 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:49:38.834603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1153/2328] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:49:48.763488 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=15 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:48.830118 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=55 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:52.847005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d0dc1-d64b-49a1-b7ee-712eddb20576 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:52.848011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d0dc1-d64b-49a1-b7ee-712eddb20576 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:52.849296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d0dc1-d64b-49a1-b7ee-712eddb20576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:52.875581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-5a9d0dc1-d64b-49a1-b7ee-712eddb20576 None None] MFA Rules not processed for user `d9c69e18847a40379daf843e87dad68b`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:49:52.877274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5a9d0dc1-d64b-49a1-b7ee-712eddb20576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:49:52.987258 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1176/2329] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:49:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:49:53.330044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc236b-0fa6-4dcf-a9e5-ee11092818ab None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:49:53.330931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc236b-0fa6-4dcf-a9e5-ee11092818ab None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:49:53.331388 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc236b-0fa6-4dcf-a9e5-ee11092818ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:49:53.351728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-66dc236b-0fa6-4dcf-a9e5-ee11092818ab None None] MFA Rules not processed for user `2f4ede1576cf4669b3a3c46d30f62f73`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:49:53.352961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-66dc236b-0fa6-4dcf-a9e5-ee11092818ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:49:53.414479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1154/2330] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:49:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:50:02.976572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=25 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:50:03.406756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=25 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:50:10.695654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d0dc1-d64b-49a1-b7ee-712eddb20576 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:50:10.697135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5a9d0dc1-d64b-49a1-b7ee-712eddb20576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:50:10.710559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d0dc1-d64b-49a1-b7ee-712eddb20576 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:50:10.715002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:50:10.715630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:50:10.715904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:50:10.716173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] PATH_INFO: `/v3/users/c402f1668cdc4665ba056032f3129646` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:50:10.717289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c402f1668cdc4665ba056032f3129646)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:50:10.719761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:50:10.767046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c402f1668cdc4665ba056032f3129646'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:10.767904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c402f1668cdc4665ba056032f3129646'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:10.768498 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c402f1668cdc4665ba056032f3129646'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:10.775419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c402f1668cdc4665ba056032f3129646'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:10.783596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4619805c-da9f-4755-ba28-e1bb3c993889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c402f1668cdc4665ba056032f3129646'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:10.802323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1177/2331] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:50:10 2022] DELETE /identity/v3/users/c402f1668cdc4665ba056032f3129646 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:50:10.982364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc236b-0fa6-4dcf-a9e5-ee11092818ab None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:50:10.994494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc236b-0fa6-4dcf-a9e5-ee11092818ab None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:50:11.055814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:50:11.056459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:50:11.056744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:50:11.057018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] PATH_INFO: `/v3/projects/2982201a1d644da4820637c9323528bf` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:50:11.058213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2982201a1d644da4820637c9323528bf)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:50:11.060161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:50:11.107778 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2982201a1d644da4820637c9323528bf', 'request_id': 'req-77ea00bf-4d32-42f0-ab33-0a7bedf42237'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:11.115032 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2982201a1d644da4820637c9323528bf', 'request_id': 'req-77ea00bf-4d32-42f0-ab33-0a7bedf42237'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:11.120745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2982201a1d644da4820637c9323528bf', 'request_id': 'req-77ea00bf-4d32-42f0-ab33-0a7bedf42237'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:11.131858 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] The token cache is being invalidate because project 2982201a1d644da4820637c9323528bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:50:11.132142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:11.132768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-77ea00bf-4d32-42f0-ab33-0a7bedf42237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:50:11.134249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1155/2332] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:50:10 2022] DELETE /identity/v3/projects/2982201a1d644da4820637c9323528bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:50:20.798749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:50:20.903359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d332c2-448f-49a3-bbc9-5275e4c59ee4 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:50:20.903640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d332c2-448f-49a3-bbc9-5275e4c59ee4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:50:20.903923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d332c2-448f-49a3-bbc9-5275e4c59ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:50:20.924665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b1d332c2-448f-49a3-bbc9-5275e4c59ee4 None None] MFA Rules not processed for user `5b91971b2a994d348a4e695b261ad914`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:50:20.925902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b1d332c2-448f-49a3-bbc9-5275e4c59ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:50:20.980944 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1178/2333] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:50:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:50:21.128931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:50:30.974369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=25 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:50:32.219248 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a3f65-b3c3-482f-a5ec-818b4fe07c2d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:50:32.219797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a3f65-b3c3-482f-a5ec-818b4fe07c2d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:50:32.219797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a3f65-b3c3-482f-a5ec-818b4fe07c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:50:32.239981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ea6a3f65-b3c3-482f-a5ec-818b4fe07c2d None None] MFA Rules not processed for user `a066d4114d3b438cacd7437966d17c66`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:50:32.241177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ea6a3f65-b3c3-482f-a5ec-818b4fe07c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:50:32.303072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1156/2334] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:50:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:50:42.296015 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=25 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:50:57.011417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d332c2-448f-49a3-bbc9-5275e4c59ee4 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:50:57.013397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b1d332c2-448f-49a3-bbc9-5275e4c59ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:50:57.070554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d332c2-448f-49a3-bbc9-5275e4c59ee4 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:50:57.074112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c40e-a742-4d18-b413-16cd1c11a271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:50:57.075336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c40e-a742-4d18-b413-16cd1c11a271 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:50:57.075620 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c40e-a742-4d18-b413-16cd1c11a271 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:50:57.075891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c40e-a742-4d18-b413-16cd1c11a271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:50:57.077614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9144c40e-a742-4d18-b413-16cd1c11a271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:50:57.143535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c40e-a742-4d18-b413-16cd1c11a271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:50:57.144941 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c40e-a742-4d18-b413-16cd1c11a271 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:50:57.155341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1179/2335] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:50:58.405158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a3f65-b3c3-482f-a5ec-818b4fe07c2d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:50:58.414806 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a3f65-b3c3-482f-a5ec-818b4fe07c2d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:50:58.420386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:50:58.421020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:50:58.421390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:50:58.421670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:50:58.423523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:50:58.501017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:50:58.502414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:50:58.514194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1157/2336] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:50:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:00.040635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c40e-a742-4d18-b413-16cd1c11a271 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:00.053137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c40e-a742-4d18-b413-16cd1c11a271 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:00.057764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbd579-e0f2-41d5-b990-9c23d6ec33e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:00.058376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbd579-e0f2-41d5-b990-9c23d6ec33e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:00.058663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbd579-e0f2-41d5-b990-9c23d6ec33e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:00.059144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbd579-e0f2-41d5-b990-9c23d6ec33e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:00.061308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dcdbd579-e0f2-41d5-b990-9c23d6ec33e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:00.076406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbd579-e0f2-41d5-b990-9c23d6ec33e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:00.077966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbd579-e0f2-41d5-b990-9c23d6ec33e3 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:00.102927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1180/2337] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:00.878027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:00.879814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:00.896238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802baa95-79c8-4bde-8482-7b06ed8e1968 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:00.901087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:00.901726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:00.902012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:00.902286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] PATH_INFO: `/v3/users/d9c69e18847a40379daf843e87dad68b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:00.903819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c69e18847a40379daf843e87dad68b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:00.905745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:00.960411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c69e18847a40379daf843e87dad68b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:00.968349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c69e18847a40379daf843e87dad68b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:00.969094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c69e18847a40379daf843e87dad68b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:00.982847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c69e18847a40379daf843e87dad68b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:00.983614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-cd15dd8b-7afc-4cdd-ab7f-1c04e34444ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c69e18847a40379daf843e87dad68b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:00.999890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1158/2338] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:00 2022] DELETE /identity/v3/users/d9c69e18847a40379daf843e87dad68b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:01.173361 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbd579-e0f2-41d5-b990-9c23d6ec33e3 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:01.184824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbd579-e0f2-41d5-b990-9c23d6ec33e3 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:01.252142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:01.252779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.253064 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.253339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] PATH_INFO: `/v3/projects/56f5e626cfad49a68a71444d5c38e8f6` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.254463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f5e626cfad49a68a71444d5c38e8f6)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:01.256469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:01.304241 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:01.313512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f5e626cfad49a68a71444d5c38e8f6', 'request_id': 'req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:01.320031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f5e626cfad49a68a71444d5c38e8f6', 'request_id': 'req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:01.327504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f5e626cfad49a68a71444d5c38e8f6', 'request_id': 'req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:01.341127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] The token cache is being invalidate because project 56f5e626cfad49a68a71444d5c38e8f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:01.341443 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:01.342097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-94542fd4-f1e5-4b8a-8075-1c4b5dcb45c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:01.343644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1181/2339] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:01 2022] DELETE /identity/v3/projects/56f5e626cfad49a68a71444d5c38e8f6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:01.349079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d96f76-66dc-44dc-92ff-6d61ebf9d4e4 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.349079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d96f76-66dc-44dc-92ff-6d61ebf9d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.349329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d96f76-66dc-44dc-92ff-6d61ebf9d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.369974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-97d96f76-66dc-44dc-92ff-6d61ebf9d4e4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:01.371882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-97d96f76-66dc-44dc-92ff-6d61ebf9d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:01.427863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:01.437937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1159/2340] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:01.445728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702b496-670c-4dfe-9ab4-581fefada51f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.446015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702b496-670c-4dfe-9ab4-581fefada51f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.446294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702b496-670c-4dfe-9ab4-581fefada51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.467097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d702b496-670c-4dfe-9ab4-581fefada51f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:01.468292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d702b496-670c-4dfe-9ab4-581fefada51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:01.476285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1182/2341] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:01.484704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d96f76-66dc-44dc-92ff-6d61ebf9d4e4 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:01.495561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d96f76-66dc-44dc-92ff-6d61ebf9d4e4 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:01.501154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd13f-ee7f-42e8-89c6-d485eaf0ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:01.501776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd13f-ee7f-42e8-89c6-d485eaf0ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.502062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd13f-ee7f-42e8-89c6-d485eaf0ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.502341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd13f-ee7f-42e8-89c6-d485eaf0ba7a admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.503028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd13f-ee7f-42e8-89c6-d485eaf0ba7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:01.503338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd13f-ee7f-42e8-89c6-d485eaf0ba7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:01.505279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd13f-ee7f-42e8-89c6-d485eaf0ba7a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:01.518678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1160/2342] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:51:01.523350 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702b496-670c-4dfe-9ab4-581fefada51f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:01.533186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702b496-670c-4dfe-9ab4-581fefada51f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:01.537825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b12f10-c203-4428-adbc-604d7ee7deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:01.538420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b12f10-c203-4428-adbc-604d7ee7deaf admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.538698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b12f10-c203-4428-adbc-604d7ee7deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.539005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b12f10-c203-4428-adbc-604d7ee7deaf admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.539636 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b12f10-c203-4428-adbc-604d7ee7deaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:01.541528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b12f10-c203-4428-adbc-604d7ee7deaf admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:01.570683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1183/2343] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:01 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:01.575704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd13f-ee7f-42e8-89c6-d485eaf0ba7a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:01.585850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd13f-ee7f-42e8-89c6-d485eaf0ba7a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:01.648429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e69fe8-ab96-4d67-9131-ca51beffcdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:01.648429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e69fe8-ab96-4d67-9131-ca51beffcdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.648429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e69fe8-ab96-4d67-9131-ca51beffcdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.648429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e69fe8-ab96-4d67-9131-ca51beffcdc0 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.648991 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e69fe8-ab96-4d67-9131-ca51beffcdc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:01.650887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e69fe8-ab96-4d67-9131-ca51beffcdc0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:01.675838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1161/2344] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:01 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:01.679883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b12f10-c203-4428-adbc-604d7ee7deaf admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:01.690881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b12f10-c203-4428-adbc-604d7ee7deaf admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:01.695552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f016d3-6c25-414e-bbbf-15bee92f3df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:01.696157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f016d3-6c25-414e-bbbf-15bee92f3df5 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.696430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f016d3-6c25-414e-bbbf-15bee92f3df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.696706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f016d3-6c25-414e-bbbf-15bee92f3df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.697388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f016d3-6c25-414e-bbbf-15bee92f3df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:01.698949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f016d3-6c25-414e-bbbf-15bee92f3df5 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:01.710539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1184/2345] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:01.714239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e69fe8-ab96-4d67-9131-ca51beffcdc0 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:01.725681 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e69fe8-ab96-4d67-9131-ca51beffcdc0 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:01.730440 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30728f-79e0-411e-ab63-203fccd1ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:01.731678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30728f-79e0-411e-ab63-203fccd1ae10 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.731958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30728f-79e0-411e-ab63-203fccd1ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.732233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30728f-79e0-411e-ab63-203fccd1ae10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.732877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30728f-79e0-411e-ab63-203fccd1ae10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:01.734470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30728f-79e0-411e-ab63-203fccd1ae10 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:01.745266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1162/2346] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:01.749655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f016d3-6c25-414e-bbbf-15bee92f3df5 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:01.759930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f016d3-6c25-414e-bbbf-15bee92f3df5 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:01.765526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7ba5-e857-4c79-8c55-859db9f095a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:01.766172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7ba5-e857-4c79-8c55-859db9f095a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.766742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7ba5-e857-4c79-8c55-859db9f095a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.767056 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7ba5-e857-4c79-8c55-859db9f095a9 admin admin] PATH_INFO: `/v3/projects/ad95c75839804662b85237a862715b3f/users/f5aeb835b78d485db3f146c0e4621e75/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.782525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7ba5-e857-4c79-8c55-859db9f095a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad95c75839804662b85237a862715b3f, user_id=f5aeb835b78d485db3f146c0e4621e75, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:01.785222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7ba5-e857-4c79-8c55-859db9f095a9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:01.798155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1185/2347] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:01 2022] PUT /identity/v3/projects/ad95c75839804662b85237a862715b3f/users/f5aeb835b78d485db3f146c0e4621e75/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:01.808200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9bc5-5e3d-4052-ae37-369b2be70cd7 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.808485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9bc5-5e3d-4052-ae37-369b2be70cd7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.808854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9bc5-5e3d-4052-ae37-369b2be70cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.836740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-db2a9bc5-5e3d-4052-ae37-369b2be70cd7 None None] MFA Rules not processed for user `f5aeb835b78d485db3f146c0e4621e75`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:01.837947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-db2a9bc5-5e3d-4052-ae37-369b2be70cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:01.910017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1163/2348] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:01.914565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7ba5-e857-4c79-8c55-859db9f095a9 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:01.978520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7ba5-e857-4c79-8c55-859db9f095a9 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:01.983784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04578685-88fa-49be-bc93-bb5977862c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:01.984424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578685-88fa-49be-bc93-bb5977862c29 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:01.984702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578685-88fa-49be-bc93-bb5977862c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:01.984971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578685-88fa-49be-bc93-bb5977862c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:01.985601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04578685-88fa-49be-bc93-bb5977862c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:01.987589 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04578685-88fa-49be-bc93-bb5977862c29 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:02.015079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1186/2349] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:01 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:02.020048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9bc5-5e3d-4052-ae37-369b2be70cd7 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:02.031724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9bc5-5e3d-4052-ae37-369b2be70cd7 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:02.080536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:02.091635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc71be9-ba61-47ec-9f8a-eb391636d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:02.092268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc71be9-ba61-47ec-9f8a-eb391636d11b admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:02.092525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc71be9-ba61-47ec-9f8a-eb391636d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:02.092793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc71be9-ba61-47ec-9f8a-eb391636d11b admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:02.093542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc71be9-ba61-47ec-9f8a-eb391636d11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:02.095512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc71be9-ba61-47ec-9f8a-eb391636d11b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:02.117159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1164/2350] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:02 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:02.121455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04578685-88fa-49be-bc93-bb5977862c29 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:02.131680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04578685-88fa-49be-bc93-bb5977862c29 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:02.136327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071c307-56e2-4fa9-aca8-77231e8e5cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:02.137420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071c307-56e2-4fa9-aca8-77231e8e5cec admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:02.137708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071c307-56e2-4fa9-aca8-77231e8e5cec admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:02.138006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071c307-56e2-4fa9-aca8-77231e8e5cec admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:02.138619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071c307-56e2-4fa9-aca8-77231e8e5cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:02.140266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071c307-56e2-4fa9-aca8-77231e8e5cec admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:02.151171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1187/2351] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:02.156111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc71be9-ba61-47ec-9f8a-eb391636d11b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:02.167083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc71be9-ba61-47ec-9f8a-eb391636d11b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:02.172186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fa010-a88d-4fdf-ab29-081c19cb4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:02.172838 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fa010-a88d-4fdf-ab29-081c19cb4a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:02.173117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fa010-a88d-4fdf-ab29-081c19cb4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:02.173436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fa010-a88d-4fdf-ab29-081c19cb4a61 admin admin] PATH_INFO: `/v3/projects/75211e63c6af4e9c8a987fd8a8b5c3cc/users/85686ea9fd254da4860b46012ec77bac/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:02.189377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fa010-a88d-4fdf-ab29-081c19cb4a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75211e63c6af4e9c8a987fd8a8b5c3cc, user_id=85686ea9fd254da4860b46012ec77bac, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:02.192075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fa010-a88d-4fdf-ab29-081c19cb4a61 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:02.205685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1165/2352] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:02 2022] PUT /identity/v3/projects/75211e63c6af4e9c8a987fd8a8b5c3cc/users/85686ea9fd254da4860b46012ec77bac/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:02.209838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071c307-56e2-4fa9-aca8-77231e8e5cec admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:02.219986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071c307-56e2-4fa9-aca8-77231e8e5cec admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:02.254009 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:02.292373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b9fdd-84a5-4bdc-ab77-bc19875c31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:02.292973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9fdd-84a5-4bdc-ab77-bc19875c31c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:02.293493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9fdd-84a5-4bdc-ab77-bc19875c31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:02.293776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9fdd-84a5-4bdc-ab77-bc19875c31c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:02.294430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b9fdd-84a5-4bdc-ab77-bc19875c31c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:02.296071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b9fdd-84a5-4bdc-ab77-bc19875c31c2 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:02.307748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1188/2353] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:02.312757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fa010-a88d-4fdf-ab29-081c19cb4a61 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:02.323097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fa010-a88d-4fdf-ab29-081c19cb4a61 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:02.328841 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356d74b-691b-41dc-a994-58f246afb36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:02.329508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356d74b-691b-41dc-a994-58f246afb36d admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:02.329817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356d74b-691b-41dc-a994-58f246afb36d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:02.330094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356d74b-691b-41dc-a994-58f246afb36d admin admin] PATH_INFO: `/v3/projects/75211e63c6af4e9c8a987fd8a8b5c3cc/users/85686ea9fd254da4860b46012ec77bac/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:02.332062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356d74b-691b-41dc-a994-58f246afb36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75211e63c6af4e9c8a987fd8a8b5c3cc, user_id=85686ea9fd254da4860b46012ec77bac, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:02.334701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356d74b-691b-41dc-a994-58f246afb36d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:02.345873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1166/2354] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:02 2022] PUT /identity/v3/projects/75211e63c6af4e9c8a987fd8a8b5c3cc/users/85686ea9fd254da4860b46012ec77bac/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:02.357702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00f27-fdae-4720-9c4a-b2fb2818c7c6 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:02.357989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00f27-fdae-4720-9c4a-b2fb2818c7c6 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:02.358270 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00f27-fdae-4720-9c4a-b2fb2818c7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:02.388815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6dc00f27-fdae-4720-9c4a-b2fb2818c7c6 None None] MFA Rules not processed for user `85686ea9fd254da4860b46012ec77bac`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:02.390037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6dc00f27-fdae-4720-9c4a-b2fb2818c7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:02.460394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1189/2355] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:02.471845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356d74b-691b-41dc-a994-58f246afb36d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:02.473560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3356d74b-691b-41dc-a994-58f246afb36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:02.535758 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356d74b-691b-41dc-a994-58f246afb36d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:02.539381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b0f4d-6dd8-4cad-9bb1-ad7b45d32cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:02.539994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b0f4d-6dd8-4cad-9bb1-ad7b45d32cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:02.540272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b0f4d-6dd8-4cad-9bb1-ad7b45d32cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:02.540542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b0f4d-6dd8-4cad-9bb1-ad7b45d32cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:02.550762 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b0f4d-6dd8-4cad-9bb1-ad7b45d32cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:02.552364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b0f4d-6dd8-4cad-9bb1-ad7b45d32cc6 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:02.563694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1167/2356] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:02.664252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc00f27-fdae-4720-9c4a-b2fb2818c7c6 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:02.674901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc00f27-fdae-4720-9c4a-b2fb2818c7c6 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:02.678489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927fda1-1696-4295-945f-487baf9e3944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:02.679124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927fda1-1696-4295-945f-487baf9e3944 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:02.679407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927fda1-1696-4295-945f-487baf9e3944 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:02.679680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927fda1-1696-4295-945f-487baf9e3944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:02.737028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927fda1-1696-4295-945f-487baf9e3944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:02.738420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927fda1-1696-4295-945f-487baf9e3944 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:02.748110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1190/2357] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:05.997012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b0f4d-6dd8-4cad-9bb1-ad7b45d32cc6 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:05.998944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-801b0f4d-6dd8-4cad-9bb1-ad7b45d32cc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:06.071653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b0f4d-6dd8-4cad-9bb1-ad7b45d32cc6 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:06.077195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:06.077793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:06.078072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:06.078342 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:06.080104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:06.127029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:06.142093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:06.143737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:06.153470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1168/2358] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:09.099386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bd916-c2c3-426b-a90e-1c252f4549b9 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:09.099904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bd916-c2c3-426b-a90e-1c252f4549b9 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:09.100011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bd916-c2c3-426b-a90e-1c252f4549b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:09.120689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-5e8bd916-c2c3-426b-a90e-1c252f4549b9 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:09.122177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5e8bd916-c2c3-426b-a90e-1c252f4549b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:09.180380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1191/2359] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:51:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:09.231563 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:09.233175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:09.308463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed17000-1a46-430d-8ece-ccf42047a434 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:09.313642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570b474-a23e-45f5-990e-78da1e0507c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:09.314262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570b474-a23e-45f5-990e-78da1e0507c1 service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:09.314539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570b474-a23e-45f5-990e-78da1e0507c1 service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:09.314835 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570b474-a23e-45f5-990e-78da1e0507c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:09.323558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570b474-a23e-45f5-990e-78da1e0507c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:09.325667 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570b474-a23e-45f5-990e-78da1e0507c1 service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:09.334552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1169/2360] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:51:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:51:19.172801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:19.331873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=39 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:22.332229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bd916-c2c3-426b-a90e-1c252f4549b9 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:22.333856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5e8bd916-c2c3-426b-a90e-1c252f4549b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:22.346131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bd916-c2c3-426b-a90e-1c252f4549b9 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:22.349831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:22.350469 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:22.350745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:22.351043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:22.352854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:22.416861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:22.419460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:22.428643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1192/2361] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:24.577915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570b474-a23e-45f5-990e-78da1e0507c1 service swift] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:24.599021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570b474-a23e-45f5-990e-78da1e0507c1 service swift] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:24.609303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:24.610415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:24.611098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:24.611599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:24.614225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:24.633254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:24.634659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:24.692289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:24.694066 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:24.706822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1170/2362] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:24.721815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3e9fd-2aac-46a0-8e50-c04361ffc271 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:24.726993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187c43c-d74c-4060-9237-a7414baf79f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:24.727693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187c43c-d74c-4060-9237-a7414baf79f3 service placement] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:24.728038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187c43c-d74c-4060-9237-a7414baf79f3 service placement] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:24.728424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187c43c-d74c-4060-9237-a7414baf79f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:24.730264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8187c43c-d74c-4060-9237-a7414baf79f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:24.743347 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187c43c-d74c-4060-9237-a7414baf79f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:24.745563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187c43c-d74c-4060-9237-a7414baf79f3 service placement] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:24.759569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1193/2363] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:25.668270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:25.669779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:25.736981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639a7cd-01e3-4eb6-9e00-1a4c7353070f service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:25.741007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbf8d-d278-4ac6-8fc5-4e903c98e6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:25.741901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbf8d-d278-4ac6-8fc5-4e903c98e6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:25.742691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbf8d-d278-4ac6-8fc5-4e903c98e6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:25.743229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbf8d-d278-4ac6-8fc5-4e903c98e6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:25.745677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-14efbf8d-d278-4ac6-8fc5-4e903c98e6a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:25.757905 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efbf8d-d278-4ac6-8fc5-4e903c98e6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:25.759894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efbf8d-d278-4ac6-8fc5-4e903c98e6a8 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:25.771149 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1171/2364] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:27.050391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b46c3-bfea-46a9-84e7-05fe907352f7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:27.050990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b46c3-bfea-46a9-84e7-05fe907352f7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:27.050990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b46c3-bfea-46a9-84e7-05fe907352f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:27.102355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ec3b46c3-bfea-46a9-84e7-05fe907352f7 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:27.103983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ec3b46c3-bfea-46a9-84e7-05fe907352f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:27.128025 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1194/2365] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:51:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:27.139071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbf8d-d278-4ac6-8fc5-4e903c98e6a8 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:27.172786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbf8d-d278-4ac6-8fc5-4e903c98e6a8 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:27.187761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57ccd4-d48e-48b7-914a-39732421ccf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:27.189125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57ccd4-d48e-48b7-914a-39732421ccf6 service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:27.189752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57ccd4-d48e-48b7-914a-39732421ccf6 service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:27.190249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57ccd4-d48e-48b7-914a-39732421ccf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:27.202465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57ccd4-d48e-48b7-914a-39732421ccf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:27.204126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57ccd4-d48e-48b7-914a-39732421ccf6 service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:27.214618 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1172/2366] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:51:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:51:32.848971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b46c3-bfea-46a9-84e7-05fe907352f7 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:32.860021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b46c3-bfea-46a9-84e7-05fe907352f7 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:32.883865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ac14d-2190-42ad-85c2-08b06ef756a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:32.884844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac14d-2190-42ad-85c2-08b06ef756a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:32.885802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac14d-2190-42ad-85c2-08b06ef756a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:32.886233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac14d-2190-42ad-85c2-08b06ef756a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:32.889413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6f1ac14d-2190-42ad-85c2-08b06ef756a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:32.964763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ac14d-2190-42ad-85c2-08b06ef756a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:32.973770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ac14d-2190-42ad-85c2-08b06ef756a7 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:32.985659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1195/2367] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:33.578585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57ccd4-d48e-48b7-914a-39732421ccf6 service swift] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:33.598044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57ccd4-d48e-48b7-914a-39732421ccf6 service swift] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:33.603593 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:33.605053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:33.605462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:33.605739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] PATH_INFO: `/v3/users/f5aeb835b78d485db3f146c0e4621e75` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:33.614892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5aeb835b78d485db3f146c0e4621e75)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:33.616874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:33.835729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5aeb835b78d485db3f146c0e4621e75'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:33.847332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5aeb835b78d485db3f146c0e4621e75'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:33.848273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5aeb835b78d485db3f146c0e4621e75'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:33.867915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5aeb835b78d485db3f146c0e4621e75'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:33.868744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5aeb835b78d485db3f146c0e4621e75'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:33.881939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:33.893602 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1173/2368] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:33 2022] DELETE /identity/v3/users/f5aeb835b78d485db3f146c0e4621e75 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:33.895247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af4e6-a18e-4e60-9e24-a24f0da0eb81 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:33.896021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af4e6-a18e-4e60-9e24-a24f0da0eb81 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:33.896021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af4e6-a18e-4e60-9e24-a24f0da0eb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:33.931649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-8c1af4e6-a18e-4e60-9e24-a24f0da0eb81 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:33.934505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8c1af4e6-a18e-4e60-9e24-a24f0da0eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:33.953634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:34.027988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1196/2369] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:34.039596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:34.041100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:34.199703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64020dcd-fe2d-421a-b4ca-ecc784cc01a0 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:34.203707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239fa3f-3e90-43dc-aef7-36ca380ade9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:34.204408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239fa3f-3e90-43dc-aef7-36ca380ade9a service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:34.204699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239fa3f-3e90-43dc-aef7-36ca380ade9a service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:34.205047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239fa3f-3e90-43dc-aef7-36ca380ade9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:34.225839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239fa3f-3e90-43dc-aef7-36ca380ade9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:34.227709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239fa3f-3e90-43dc-aef7-36ca380ade9a service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:34.267298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1174/2370] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:34.875776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af4e6-a18e-4e60-9e24-a24f0da0eb81 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:34.881010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8c1af4e6-a18e-4e60-9e24-a24f0da0eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:34.895035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af4e6-a18e-4e60-9e24-a24f0da0eb81 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:34.907917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:34.911551 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:34.912043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:34.912481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] PATH_INFO: `/v3/projects/ad95c75839804662b85237a862715b3f` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:34.915612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad95c75839804662b85237a862715b3f)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:34.920596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:35.044487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad95c75839804662b85237a862715b3f', 'request_id': 'req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.055213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad95c75839804662b85237a862715b3f', 'request_id': 'req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.065363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad95c75839804662b85237a862715b3f', 'request_id': 'req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.097922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] The token cache is being invalidate because project ad95c75839804662b85237a862715b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:35.098305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.099167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.100789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1197/2371] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:34 2022] DELETE /identity/v3/projects/ad95c75839804662b85237a862715b3f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:35.105670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239fa3f-3e90-43dc-aef7-36ca380ade9a service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:35.117805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239fa3f-3e90-43dc-aef7-36ca380ade9a service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:35.227366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:35.228375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:35.229068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:35.229825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] PATH_INFO: `/v3/users/85686ea9fd254da4860b46012ec77bac` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:35.231366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85686ea9fd254da4860b46012ec77bac)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:35.233513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:35.287697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85686ea9fd254da4860b46012ec77bac'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.295163 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85686ea9fd254da4860b46012ec77bac'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.295952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85686ea9fd254da4860b46012ec77bac'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.316561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85686ea9fd254da4860b46012ec77bac'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.316561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9a8fc37e-ab64-4816-b3b9-9abf074e2d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85686ea9fd254da4860b46012ec77bac'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.334044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1175/2372] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:35 2022] DELETE /identity/v3/users/85686ea9fd254da4860b46012ec77bac => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:35.656501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:35.658604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:35.679437 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bfdba-dde4-411a-b0a1-c37d2cf296f1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:35.756584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:35.757428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:35.757558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:35.758006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] PATH_INFO: `/v3/projects/75211e63c6af4e9c8a987fd8a8b5c3cc` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:35.759386 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=75211e63c6af4e9c8a987fd8a8b5c3cc)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:35.761647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:35.828861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:35.841082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75211e63c6af4e9c8a987fd8a8b5c3cc', 'request_id': 'req-0472d974-6aac-443d-bfac-dfe038a985ac'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.855343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75211e63c6af4e9c8a987fd8a8b5c3cc', 'request_id': 'req-0472d974-6aac-443d-bfac-dfe038a985ac'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.863483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75211e63c6af4e9c8a987fd8a8b5c3cc', 'request_id': 'req-0472d974-6aac-443d-bfac-dfe038a985ac'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.880795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] The token cache is being invalidate because project 75211e63c6af4e9c8a987fd8a8b5c3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:35.881103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.881761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0472d974-6aac-443d-bfac-dfe038a985ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:35.884903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1198/2373] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:35 2022] DELETE /identity/v3/projects/75211e63c6af4e9c8a987fd8a8b5c3cc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:35.893102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c67e17-60e6-496a-afac-ffb9ed1fded2 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:35.893809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c67e17-60e6-496a-afac-ffb9ed1fded2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:35.894597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c67e17-60e6-496a-afac-ffb9ed1fded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:35.918394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b6c67e17-60e6-496a-afac-ffb9ed1fded2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:35.919685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b6c67e17-60e6-496a-afac-ffb9ed1fded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:35.958592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:36.019659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1176/2374] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:36.028128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5469dd4-8a80-49f1-9da4-1a63b08917ae None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.028673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5469dd4-8a80-49f1-9da4-1a63b08917ae None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.028673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5469dd4-8a80-49f1-9da4-1a63b08917ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.053764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d5469dd4-8a80-49f1-9da4-1a63b08917ae None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:36.055046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d5469dd4-8a80-49f1-9da4-1a63b08917ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:36.070999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1199/2375] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:36.071618 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c67e17-60e6-496a-afac-ffb9ed1fded2 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:36.084617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c67e17-60e6-496a-afac-ffb9ed1fded2 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:36.090329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0b3d-ac66-40d6-874f-71e3a360f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:36.091130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0b3d-ac66-40d6-874f-71e3a360f721 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.091791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0b3d-ac66-40d6-874f-71e3a360f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.092332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0b3d-ac66-40d6-874f-71e3a360f721 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.093100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0b3d-ac66-40d6-874f-71e3a360f721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:36.093511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0b3d-ac66-40d6-874f-71e3a360f721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:36.095525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0b3d-ac66-40d6-874f-71e3a360f721 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:36.110046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1177/2376] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:51:36.115721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5469dd4-8a80-49f1-9da4-1a63b08917ae None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:36.130104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5469dd4-8a80-49f1-9da4-1a63b08917ae None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:36.137514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084c1e9-5c78-487b-8f86-724c53a21268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:36.138297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084c1e9-5c78-487b-8f86-724c53a21268 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.139763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084c1e9-5c78-487b-8f86-724c53a21268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.140151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084c1e9-5c78-487b-8f86-724c53a21268 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.141902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084c1e9-5c78-487b-8f86-724c53a21268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:36.150177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084c1e9-5c78-487b-8f86-724c53a21268 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:36.207907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1200/2377] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:36 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:36.210151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0b3d-ac66-40d6-874f-71e3a360f721 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:36.238917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0b3d-ac66-40d6-874f-71e3a360f721 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:36.344554 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215487b2-8ffe-4409-b0e0-15d4ced8e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:36.345146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215487b2-8ffe-4409-b0e0-15d4ced8e486 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.345483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215487b2-8ffe-4409-b0e0-15d4ced8e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.345808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215487b2-8ffe-4409-b0e0-15d4ced8e486 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.346534 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215487b2-8ffe-4409-b0e0-15d4ced8e486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:36.348511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215487b2-8ffe-4409-b0e0-15d4ced8e486 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:36.372830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1178/2378] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:36 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:36.377014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084c1e9-5c78-487b-8f86-724c53a21268 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:36.388499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084c1e9-5c78-487b-8f86-724c53a21268 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:36.394971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b27ec-f36c-4800-b466-c4ab22afc669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:36.395888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b27ec-f36c-4800-b466-c4ab22afc669 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.396275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b27ec-f36c-4800-b466-c4ab22afc669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.396650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b27ec-f36c-4800-b466-c4ab22afc669 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.397486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b27ec-f36c-4800-b466-c4ab22afc669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:36.399258 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b27ec-f36c-4800-b466-c4ab22afc669 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:36.418030 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1201/2379] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:36.418359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215487b2-8ffe-4409-b0e0-15d4ced8e486 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:36.429241 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215487b2-8ffe-4409-b0e0-15d4ced8e486 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:36.434875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65041d33-a514-40a6-893a-5657c5337022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:36.435481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65041d33-a514-40a6-893a-5657c5337022 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.435788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65041d33-a514-40a6-893a-5657c5337022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.436065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65041d33-a514-40a6-893a-5657c5337022 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.436732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65041d33-a514-40a6-893a-5657c5337022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:36.438332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65041d33-a514-40a6-893a-5657c5337022 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:36.451970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1179/2380] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:36.457708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b27ec-f36c-4800-b466-c4ab22afc669 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:36.470033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b27ec-f36c-4800-b466-c4ab22afc669 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:36.475026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf9dc9-50c7-4830-bdfc-58614abeb544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:36.475692 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf9dc9-50c7-4830-bdfc-58614abeb544 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.475977 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf9dc9-50c7-4830-bdfc-58614abeb544 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.476263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf9dc9-50c7-4830-bdfc-58614abeb544 admin admin] PATH_INFO: `/v3/projects/31c36821322d411389edca69457f802c/users/04b4b421f154438f9c372f32849161f8/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.492038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf9dc9-50c7-4830-bdfc-58614abeb544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c36821322d411389edca69457f802c, user_id=04b4b421f154438f9c372f32849161f8, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:36.495136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf9dc9-50c7-4830-bdfc-58614abeb544 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:36.513035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1202/2381] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:36 2022] PUT /identity/v3/projects/31c36821322d411389edca69457f802c/users/04b4b421f154438f9c372f32849161f8/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:36.524893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70f76-b54d-4e40-9bde-11a2a421eafd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.525116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70f76-b54d-4e40-9bde-11a2a421eafd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.525400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70f76-b54d-4e40-9bde-11a2a421eafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.556790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c1a70f76-b54d-4e40-9bde-11a2a421eafd None None] MFA Rules not processed for user `04b4b421f154438f9c372f32849161f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:36.558802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c1a70f76-b54d-4e40-9bde-11a2a421eafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:36.663198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1180/2382] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:36.668961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf9dc9-50c7-4830-bdfc-58614abeb544 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:36.750204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf9dc9-50c7-4830-bdfc-58614abeb544 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:36.755666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9750e-d549-47d3-9b74-b8e84205b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:36.756810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9750e-d549-47d3-9b74-b8e84205b7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.757124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9750e-d549-47d3-9b74-b8e84205b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.757650 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9750e-d549-47d3-9b74-b8e84205b7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.758248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9750e-d549-47d3-9b74-b8e84205b7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:36.761726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9750e-d549-47d3-9b74-b8e84205b7e6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:36.798851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1203/2383] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:36 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:36.804037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a70f76-b54d-4e40-9bde-11a2a421eafd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:36.816492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a70f76-b54d-4e40-9bde-11a2a421eafd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:36.837512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:36.906992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583adbb-7c27-4a4c-9742-0777c504bb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:36.908275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583adbb-7c27-4a4c-9742-0777c504bb3b admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:36.908893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583adbb-7c27-4a4c-9742-0777c504bb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:36.909522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583adbb-7c27-4a4c-9742-0777c504bb3b admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:36.911908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583adbb-7c27-4a4c-9742-0777c504bb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:36.915404 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583adbb-7c27-4a4c-9742-0777c504bb3b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:36.966186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1181/2384] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:36 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:36.970369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9750e-d549-47d3-9b74-b8e84205b7e6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:36.998404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9750e-d549-47d3-9b74-b8e84205b7e6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:37.013106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfc85c-9eee-4854-953b-571c1d3dd158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:37.013746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfc85c-9eee-4854-953b-571c1d3dd158 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:37.014038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfc85c-9eee-4854-953b-571c1d3dd158 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:37.014295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfc85c-9eee-4854-953b-571c1d3dd158 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:37.014993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfc85c-9eee-4854-953b-571c1d3dd158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:37.023431 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfc85c-9eee-4854-953b-571c1d3dd158 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:37.064864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1204/2385] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:51:37.067322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583adbb-7c27-4a4c-9742-0777c504bb3b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:37.082522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583adbb-7c27-4a4c-9742-0777c504bb3b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:37.090208 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f1f28-96a0-4c65-a82f-64e32fd30438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:37.091650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f1f28-96a0-4c65-a82f-64e32fd30438 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:37.093033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f1f28-96a0-4c65-a82f-64e32fd30438 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:37.093330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f1f28-96a0-4c65-a82f-64e32fd30438 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:37.094007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f1f28-96a0-4c65-a82f-64e32fd30438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:37.109849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f1f28-96a0-4c65-a82f-64e32fd30438 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:37.135065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1182/2386] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:51:37.138691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfc85c-9eee-4854-953b-571c1d3dd158 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:37.151270 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfc85c-9eee-4854-953b-571c1d3dd158 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:37.170920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e047e94-be4e-44b0-b250-22ab3a512796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:37.172105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e047e94-be4e-44b0-b250-22ab3a512796 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:37.172571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e047e94-be4e-44b0-b250-22ab3a512796 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:37.173020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e047e94-be4e-44b0-b250-22ab3a512796 admin admin] PATH_INFO: `/v3/projects/b9b8b1eec58449d78df5892f92859357/users/4dc72db39a12411baceb1ed2da9642b6/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:37.200270 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e047e94-be4e-44b0-b250-22ab3a512796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b8b1eec58449d78df5892f92859357, user_id=4dc72db39a12411baceb1ed2da9642b6, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:37.214754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e047e94-be4e-44b0-b250-22ab3a512796 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:37.246553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1205/2387] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:37 2022] PUT /identity/v3/projects/b9b8b1eec58449d78df5892f92859357/users/4dc72db39a12411baceb1ed2da9642b6/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:37.249522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fea37-8121-4ef5-96e7-df336bdc9e88 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:37.249848 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fea37-8121-4ef5-96e7-df336bdc9e88 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:37.250129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fea37-8121-4ef5-96e7-df336bdc9e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:37.312339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-585fea37-8121-4ef5-96e7-df336bdc9e88 None None] MFA Rules not processed for user `4dc72db39a12411baceb1ed2da9642b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:37.315359 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-585fea37-8121-4ef5-96e7-df336bdc9e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:37.476770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1183/2388] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:37.481506 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e047e94-be4e-44b0-b250-22ab3a512796 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:37.535372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:37.627582 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fea37-8121-4ef5-96e7-df336bdc9e88 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:37.629988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-585fea37-8121-4ef5-96e7-df336bdc9e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:37.677580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e047e94-be4e-44b0-b250-22ab3a512796 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:37.696262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87f31d-6a12-4873-b0f4-b8db86377e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:37.697171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87f31d-6a12-4873-b0f4-b8db86377e88 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:37.697522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87f31d-6a12-4873-b0f4-b8db86377e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:37.697797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87f31d-6a12-4873-b0f4-b8db86377e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:37.698436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87f31d-6a12-4873-b0f4-b8db86377e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:37.701087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87f31d-6a12-4873-b0f4-b8db86377e88 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:37.753884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1206/2389] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:37 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:37.758531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87f31d-6a12-4873-b0f4-b8db86377e88 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:37.778163 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fea37-8121-4ef5-96e7-df336bdc9e88 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:37.814062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:37.891781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca40f7f-d7a7-4c2d-a909-a472327f85f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:37.892449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca40f7f-d7a7-4c2d-a909-a472327f85f6 service placement] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:37.892967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca40f7f-d7a7-4c2d-a909-a472327f85f6 service placement] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:37.893093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87f31d-6a12-4873-b0f4-b8db86377e88 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:37.894439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca40f7f-d7a7-4c2d-a909-a472327f85f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:37.899543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242047c-9921-4529-9484-cb3cfc3ea285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:37.900282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242047c-9921-4529-9484-cb3cfc3ea285 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:37.901991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242047c-9921-4529-9484-cb3cfc3ea285 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:37.902482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1ca40f7f-d7a7-4c2d-a909-a472327f85f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:37.902594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242047c-9921-4529-9484-cb3cfc3ea285 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:37.903387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242047c-9921-4529-9484-cb3cfc3ea285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:37.905649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242047c-9921-4529-9484-cb3cfc3ea285 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:37.923213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca40f7f-d7a7-4c2d-a909-a472327f85f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:37.927318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca40f7f-d7a7-4c2d-a909-a472327f85f6 service placement] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:37.938973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1207/2390] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:37 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:37.939981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242047c-9921-4529-9484-cb3cfc3ea285 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:37.942233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e242047c-9921-4529-9484-cb3cfc3ea285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:37.957346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242047c-9921-4529-9484-cb3cfc3ea285 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:37.958316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1184/2391] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:37.961174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca40f7f-d7a7-4c2d-a909-a472327f85f6 service placement] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:37.973989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:37.975415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:37.975926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:37.976271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] PATH_INFO: `/v3/users/5b91971b2a994d348a4e695b261ad914` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:37.977954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b91971b2a994d348a4e695b261ad914)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:37.979860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:37.989808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca40f7f-d7a7-4c2d-a909-a472327f85f6 service placement] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.003461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a1a62-5077-4875-8d9a-8db4892eac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.004278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a1a62-5077-4875-8d9a-8db4892eac80 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.004656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a1a62-5077-4875-8d9a-8db4892eac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.005037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a1a62-5077-4875-8d9a-8db4892eac80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.005786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a1a62-5077-4875-8d9a-8db4892eac80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.011844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a1a62-5077-4875-8d9a-8db4892eac80 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.033148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1185/2392] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:38.039759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a1a62-5077-4875-8d9a-8db4892eac80 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.051678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b91971b2a994d348a4e695b261ad914'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.052999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a1a62-5077-4875-8d9a-8db4892eac80 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.053159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b91971b2a994d348a4e695b261ad914'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.053840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b91971b2a994d348a4e695b261ad914'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.058392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735963d-8bc6-4b89-ac27-86478ee013dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.059811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735963d-8bc6-4b89-ac27-86478ee013dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.059974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735963d-8bc6-4b89-ac27-86478ee013dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.060180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735963d-8bc6-4b89-ac27-86478ee013dc admin admin] PATH_INFO: `/v3/projects/015f13ade2e74f7195a959c8fda440c7/users/a31dcbc17bc44a7da2407b9805b992a8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.071926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b91971b2a994d348a4e695b261ad914'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.084970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b91971b2a994d348a4e695b261ad914'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.089604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735963d-8bc6-4b89-ac27-86478ee013dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=015f13ade2e74f7195a959c8fda440c7, user_id=a31dcbc17bc44a7da2407b9805b992a8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.092325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735963d-8bc6-4b89-ac27-86478ee013dc admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.115356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1186/2393] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:38 2022] PUT /identity/v3/projects/015f13ade2e74f7195a959c8fda440c7/users/a31dcbc17bc44a7da2407b9805b992a8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:38.116511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1208/2394] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:37 2022] DELETE /identity/v3/users/5b91971b2a994d348a4e695b261ad914 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:38.119174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735963d-8bc6-4b89-ac27-86478ee013dc admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.121345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5735963d-8bc6-4b89-ac27-86478ee013dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:38.192972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735963d-8bc6-4b89-ac27-86478ee013dc admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.253633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa725f95-ac5a-4951-92a8-102e29b157fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.254283 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa725f95-ac5a-4951-92a8-102e29b157fe admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.254568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa725f95-ac5a-4951-92a8-102e29b157fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.254870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa725f95-ac5a-4951-92a8-102e29b157fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.255537 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa725f95-ac5a-4951-92a8-102e29b157fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.257132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa725f95-ac5a-4951-92a8-102e29b157fe admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.268417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1187/2395] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:51:38.272395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.278619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:38.285377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c198c2a-6215-435d-8b1b-acef1e717f58 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.293953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592968ca-5b39-41bb-94ce-7ff6adeca4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.295283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592968ca-5b39-41bb-94ce-7ff6adeca4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.295818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592968ca-5b39-41bb-94ce-7ff6adeca4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.296305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592968ca-5b39-41bb-94ce-7ff6adeca4c4 admin admin] PATH_INFO: `/v3/projects/015f13ade2e74f7195a959c8fda440c7/users/a31dcbc17bc44a7da2407b9805b992a8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.302383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592968ca-5b39-41bb-94ce-7ff6adeca4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015f13ade2e74f7195a959c8fda440c7, user_id=a31dcbc17bc44a7da2407b9805b992a8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.304321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592968ca-5b39-41bb-94ce-7ff6adeca4c4 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.309750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa725f95-ac5a-4951-92a8-102e29b157fe admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.312360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fa725f95-ac5a-4951-92a8-102e29b157fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:38.319497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1209/2396] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:38 2022] PUT /identity/v3/projects/015f13ade2e74f7195a959c8fda440c7/users/a31dcbc17bc44a7da2407b9805b992a8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:38.329294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa725f95-ac5a-4951-92a8-102e29b157fe admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.330494 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da65b3-3373-48db-ac35-d143b8bfd269 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.330812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da65b3-3373-48db-ac35-d143b8bfd269 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.331084 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da65b3-3373-48db-ac35-d143b8bfd269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.375249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d7da65b3-3373-48db-ac35-d143b8bfd269 None None] MFA Rules not processed for user `a31dcbc17bc44a7da2407b9805b992a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:38.377677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d7da65b3-3373-48db-ac35-d143b8bfd269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:38.383213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:38.438115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.438714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.439334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.439644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] PATH_INFO: `/v3/projects/82cb793b820748d3a224512931cbb154` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.440896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cb793b820748d3a224512931cbb154)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.443087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.477685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1210/2397] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:38.492405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da65b3-3373-48db-ac35-d143b8bfd269 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.493793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d7da65b3-3373-48db-ac35-d143b8bfd269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:38.500086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cb793b820748d3a224512931cbb154', 'request_id': 'req-0401193f-7005-4a20-8415-76db07fd97db'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.508989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cb793b820748d3a224512931cbb154', 'request_id': 'req-0401193f-7005-4a20-8415-76db07fd97db'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.516415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cb793b820748d3a224512931cbb154', 'request_id': 'req-0401193f-7005-4a20-8415-76db07fd97db'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.531161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] The token cache is being invalidate because project 82cb793b820748d3a224512931cbb154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:38.531564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.532444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-0401193f-7005-4a20-8415-76db07fd97db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:38.535114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1188/2398] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:38 2022] DELETE /identity/v3/projects/82cb793b820748d3a224512931cbb154 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:38.539667 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9659-bfca-4815-9f4c-e8ecd88b435a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.539956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9659-bfca-4815-9f4c-e8ecd88b435a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.540274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9659-bfca-4815-9f4c-e8ecd88b435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.561341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da65b3-3373-48db-ac35-d143b8bfd269 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.561900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-8e6c9659-bfca-4815-9f4c-e8ecd88b435a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:38.563155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8e6c9659-bfca-4815-9f4c-e8ecd88b435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:38.638400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c1f7b-aa7d-4c86-92c9-b8c96da0c01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.639641 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c1f7b-aa7d-4c86-92c9-b8c96da0c01a service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.640195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c1f7b-aa7d-4c86-92c9-b8c96da0c01a service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.640525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c1f7b-aa7d-4c86-92c9-b8c96da0c01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.643791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1a2c1f7b-aa7d-4c86-92c9-b8c96da0c01a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:38.658107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1189/2399] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:38.665952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675d31-36a1-4721-98be-7f6d87f3d544 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.667249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675d31-36a1-4721-98be-7f6d87f3d544 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.667728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675d31-36a1-4721-98be-7f6d87f3d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.689916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f0675d31-36a1-4721-98be-7f6d87f3d544 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:38.691193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f0675d31-36a1-4721-98be-7f6d87f3d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:38.699899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1190/2400] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:38.703864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675d31-36a1-4721-98be-7f6d87f3d544 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.713007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:38.714561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675d31-36a1-4721-98be-7f6d87f3d544 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.719948 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d0f3d-e674-48bb-bd25-6323b160a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.720559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0f3d-e674-48bb-bd25-6323b160a341 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.720845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0f3d-e674-48bb-bd25-6323b160a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.721120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0f3d-e674-48bb-bd25-6323b160a341 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.721774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d0f3d-e674-48bb-bd25-6323b160a341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:38.722532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d0f3d-e674-48bb-bd25-6323b160a341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.723693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d0f3d-e674-48bb-bd25-6323b160a341 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.734735 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c1f7b-aa7d-4c86-92c9-b8c96da0c01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.736345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c1f7b-aa7d-4c86-92c9-b8c96da0c01a service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.737897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1191/2401] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:51:38.742021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d0f3d-e674-48bb-bd25-6323b160a341 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.747838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1211/2402] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:51:38.756712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d0f3d-e674-48bb-bd25-6323b160a341 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.763707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7ec63-8ef7-408e-b3b4-776dff5b45de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.764397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7ec63-8ef7-408e-b3b4-776dff5b45de admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.765048 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7ec63-8ef7-408e-b3b4-776dff5b45de admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.765387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7ec63-8ef7-408e-b3b4-776dff5b45de admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.766444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7ec63-8ef7-408e-b3b4-776dff5b45de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.768559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7ec63-8ef7-408e-b3b4-776dff5b45de admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.816060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1192/2403] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:38 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:38.817657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c1f7b-aa7d-4c86-92c9-b8c96da0c01a service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.828452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c1f7b-aa7d-4c86-92c9-b8c96da0c01a service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.894112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb182de-7412-4730-81b1-5b1108dcccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.894750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb182de-7412-4730-81b1-5b1108dcccbd admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.895166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb182de-7412-4730-81b1-5b1108dcccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.895634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb182de-7412-4730-81b1-5b1108dcccbd admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.896642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb182de-7412-4730-81b1-5b1108dcccbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.899221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb182de-7412-4730-81b1-5b1108dcccbd admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.925329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1212/2404] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:38 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:38.930025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7ec63-8ef7-408e-b3b4-776dff5b45de admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.941931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7ec63-8ef7-408e-b3b4-776dff5b45de admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.947684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5a391-dac6-4712-9fba-ad9ea28e76ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.948432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5a391-dac6-4712-9fba-ad9ea28e76ea admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.948752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5a391-dac6-4712-9fba-ad9ea28e76ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.949029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5a391-dac6-4712-9fba-ad9ea28e76ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.949806 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5a391-dac6-4712-9fba-ad9ea28e76ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.951886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5a391-dac6-4712-9fba-ad9ea28e76ea admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:38.964383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1193/2405] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:38.969045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb182de-7412-4730-81b1-5b1108dcccbd admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:38.983105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb182de-7412-4730-81b1-5b1108dcccbd admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:38.988432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd69f34-7941-4f58-b47e-95f513ebb232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:38.989041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69f34-7941-4f58-b47e-95f513ebb232 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:38.989323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69f34-7941-4f58-b47e-95f513ebb232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:38.989597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69f34-7941-4f58-b47e-95f513ebb232 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:38.990243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd69f34-7941-4f58-b47e-95f513ebb232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:38.991923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd69f34-7941-4f58-b47e-95f513ebb232 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:39.003178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1213/2406] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:39.007548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5a391-dac6-4712-9fba-ad9ea28e76ea admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:39.020383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5a391-dac6-4712-9fba-ad9ea28e76ea admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:39.021616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:39.027719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014c792-2798-40e2-8ab1-61c2bb05158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:39.028685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014c792-2798-40e2-8ab1-61c2bb05158d admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.029529 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014c792-2798-40e2-8ab1-61c2bb05158d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.029999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014c792-2798-40e2-8ab1-61c2bb05158d admin admin] PATH_INFO: `/v3/projects/b1bd87bb942841b7b16317fcfacf9d55/users/e5a71627d3e74e32a62a175817a8e43f/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.049469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014c792-2798-40e2-8ab1-61c2bb05158d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bd87bb942841b7b16317fcfacf9d55, user_id=e5a71627d3e74e32a62a175817a8e43f, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:39.052531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014c792-2798-40e2-8ab1-61c2bb05158d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:39.080914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1194/2407] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:39 2022] PUT /identity/v3/projects/b1bd87bb942841b7b16317fcfacf9d55/users/e5a71627d3e74e32a62a175817a8e43f/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:39.091428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb921285-582f-4316-90c1-efe4e8b1387a None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.091958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb921285-582f-4316-90c1-efe4e8b1387a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.092050 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb921285-582f-4316-90c1-efe4e8b1387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.126211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-fb921285-582f-4316-90c1-efe4e8b1387a None None] MFA Rules not processed for user `e5a71627d3e74e32a62a175817a8e43f`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:39.128281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-fb921285-582f-4316-90c1-efe4e8b1387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:39.209885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1214/2408] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:39.215015 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014c792-2798-40e2-8ab1-61c2bb05158d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:39.281252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014c792-2798-40e2-8ab1-61c2bb05158d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:39.286037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24328c18-17ff-41e8-8471-04079eca66ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:39.286674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24328c18-17ff-41e8-8471-04079eca66ee admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.287023 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24328c18-17ff-41e8-8471-04079eca66ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.287346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24328c18-17ff-41e8-8471-04079eca66ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.288009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24328c18-17ff-41e8-8471-04079eca66ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:39.290029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24328c18-17ff-41e8-8471-04079eca66ee admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:39.322909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1195/2409] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:39 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:39.325467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb921285-582f-4316-90c1-efe4e8b1387a None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:39.339614 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb921285-582f-4316-90c1-efe4e8b1387a None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:39.398393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:39.410488 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330bbc8-5c02-466f-937b-e4fef3ae46f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:39.411140 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330bbc8-5c02-466f-937b-e4fef3ae46f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.411424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330bbc8-5c02-466f-937b-e4fef3ae46f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.411694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330bbc8-5c02-466f-937b-e4fef3ae46f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.412339 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330bbc8-5c02-466f-937b-e4fef3ae46f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:39.414274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330bbc8-5c02-466f-937b-e4fef3ae46f4 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:39.438700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1215/2410] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:39 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:39.442990 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24328c18-17ff-41e8-8471-04079eca66ee admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:39.454319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24328c18-17ff-41e8-8471-04079eca66ee admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:39.459780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3dfbf-c19c-45d2-98ff-8a925b68d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:39.460397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3dfbf-c19c-45d2-98ff-8a925b68d652 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.460677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3dfbf-c19c-45d2-98ff-8a925b68d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.460945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3dfbf-c19c-45d2-98ff-8a925b68d652 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.461595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3dfbf-c19c-45d2-98ff-8a925b68d652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:39.463512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3dfbf-c19c-45d2-98ff-8a925b68d652 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:39.477544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1196/2411] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:39.482247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330bbc8-5c02-466f-937b-e4fef3ae46f4 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:39.493766 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330bbc8-5c02-466f-937b-e4fef3ae46f4 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:39.499222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202534e-b5aa-4a1d-af1a-567c5ceb89bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:39.500054 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202534e-b5aa-4a1d-af1a-567c5ceb89bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.500173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202534e-b5aa-4a1d-af1a-567c5ceb89bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.500433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202534e-b5aa-4a1d-af1a-567c5ceb89bc admin admin] PATH_INFO: `/v3/projects/cd35765ccd3f48758a44848425eb057b/users/01cbdc45d79b49adba0709af24816b48/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.517282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202534e-b5aa-4a1d-af1a-567c5ceb89bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd35765ccd3f48758a44848425eb057b, user_id=01cbdc45d79b49adba0709af24816b48, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:39.520081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202534e-b5aa-4a1d-af1a-567c5ceb89bc admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:39.535128 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1216/2412] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:39 2022] PUT /identity/v3/projects/cd35765ccd3f48758a44848425eb057b/users/01cbdc45d79b49adba0709af24816b48/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:39.539083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3dfbf-c19c-45d2-98ff-8a925b68d652 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:39.549718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3dfbf-c19c-45d2-98ff-8a925b68d652 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:39.611237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181731b-26f8-477a-b925-34279b98e839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:39.611861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181731b-26f8-477a-b925-34279b98e839 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.612144 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181731b-26f8-477a-b925-34279b98e839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.612424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181731b-26f8-477a-b925-34279b98e839 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.613071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181731b-26f8-477a-b925-34279b98e839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:39.614912 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181731b-26f8-477a-b925-34279b98e839 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:39.630219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1197/2413] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:39.631784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202534e-b5aa-4a1d-af1a-567c5ceb89bc admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:39.647460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202534e-b5aa-4a1d-af1a-567c5ceb89bc admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:39.654220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1e4ae-bcdd-4494-b6be-423d50c831fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:39.654399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1e4ae-bcdd-4494-b6be-423d50c831fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.654633 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1e4ae-bcdd-4494-b6be-423d50c831fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.654954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1e4ae-bcdd-4494-b6be-423d50c831fb admin admin] PATH_INFO: `/v3/projects/cd35765ccd3f48758a44848425eb057b/users/01cbdc45d79b49adba0709af24816b48/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.656988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1e4ae-bcdd-4494-b6be-423d50c831fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd35765ccd3f48758a44848425eb057b, user_id=01cbdc45d79b49adba0709af24816b48, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:39.659677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1e4ae-bcdd-4494-b6be-423d50c831fb admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:39.671346 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1217/2414] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:39 2022] PUT /identity/v3/projects/cd35765ccd3f48758a44848425eb057b/users/01cbdc45d79b49adba0709af24816b48/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:39.683468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f83d7-ae0b-49c1-a47d-b13765dfde65 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.683760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f83d7-ae0b-49c1-a47d-b13765dfde65 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.684042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f83d7-ae0b-49c1-a47d-b13765dfde65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.711548 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-2d5f83d7-ae0b-49c1-a47d-b13765dfde65 None None] MFA Rules not processed for user `01cbdc45d79b49adba0709af24816b48`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:39.712756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2d5f83d7-ae0b-49c1-a47d-b13765dfde65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:39.753295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:39.782069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1198/2415] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:39.794536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1e4ae-bcdd-4494-b6be-423d50c831fb admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:39.796310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9ac1e4ae-bcdd-4494-b6be-423d50c831fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:39.857540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1e4ae-bcdd-4494-b6be-423d50c831fb admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:39.861334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357eea4e-aa4a-422e-9846-884967b35ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:39.861957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eea4e-aa4a-422e-9846-884967b35ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.862237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eea4e-aa4a-422e-9846-884967b35ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.862512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eea4e-aa4a-422e-9846-884967b35ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:39.873742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357eea4e-aa4a-422e-9846-884967b35ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:39.875251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357eea4e-aa4a-422e-9846-884967b35ad9 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:39.885980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1218/2416] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:39.966854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f83d7-ae0b-49c1-a47d-b13765dfde65 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:39.987450 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f83d7-ae0b-49c1-a47d-b13765dfde65 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:39.991094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc767078-eae7-4d76-a6dd-ca023b47adff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:39.991711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc767078-eae7-4d76-a6dd-ca023b47adff service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:39.991992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc767078-eae7-4d76-a6dd-ca023b47adff service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:39.992264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc767078-eae7-4d76-a6dd-ca023b47adff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:40.050946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc767078-eae7-4d76-a6dd-ca023b47adff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:40.052541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc767078-eae7-4d76-a6dd-ca023b47adff service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:40.061496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1199/2417] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:40.325252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357eea4e-aa4a-422e-9846-884967b35ad9 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:40.334006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357eea4e-aa4a-422e-9846-884967b35ad9 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:40.338172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa63046-dfe6-4282-bf12-5fb3a08315a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:40.339267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63046-dfe6-4282-bf12-5fb3a08315a7 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:40.339559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63046-dfe6-4282-bf12-5fb3a08315a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:40.339943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63046-dfe6-4282-bf12-5fb3a08315a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:40.343607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9fa63046-dfe6-4282-bf12-5fb3a08315a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:40.361729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc767078-eae7-4d76-a6dd-ca023b47adff service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:40.409819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa63046-dfe6-4282-bf12-5fb3a08315a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:40.411315 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa63046-dfe6-4282-bf12-5fb3a08315a7 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:40.421281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1219/2418] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:40.428904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc767078-eae7-4d76-a6dd-ca023b47adff service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:40.433752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:40.434431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:40.435189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:40.435467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] PATH_INFO: `/v3/users/e5a71627d3e74e32a62a175817a8e43f` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:40.436612 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a71627d3e74e32a62a175817a8e43f)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:40.438541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:40.487583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a71627d3e74e32a62a175817a8e43f'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:40.495102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a71627d3e74e32a62a175817a8e43f'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:40.495721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a71627d3e74e32a62a175817a8e43f'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:40.511847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a71627d3e74e32a62a175817a8e43f'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:40.512959 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a71627d3e74e32a62a175817a8e43f'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:40.516889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:40.534488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1200/2419] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:40 2022] DELETE /identity/v3/users/e5a71627d3e74e32a62a175817a8e43f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:40.539033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ea1e-b455-4b61-9340-b215f3254536 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:40.539358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ea1e-b455-4b61-9340-b215f3254536 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:40.539586 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ea1e-b455-4b61-9340-b215f3254536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:40.560074 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a6f2ea1e-b455-4b61-9340-b215f3254536 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:40.561324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a6f2ea1e-b455-4b61-9340-b215f3254536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:40.609321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:40.641197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1220/2420] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:40.651940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:40.653583 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:40.735080 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcc043-31e1-4aaa-9b26-426faef00085 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:40.738736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50df23-23c8-4503-8fb5-00bbf333d159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:40.739372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50df23-23c8-4503-8fb5-00bbf333d159 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:40.739679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50df23-23c8-4503-8fb5-00bbf333d159 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:40.739941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50df23-23c8-4503-8fb5-00bbf333d159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:40.749660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50df23-23c8-4503-8fb5-00bbf333d159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:40.751148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50df23-23c8-4503-8fb5-00bbf333d159 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:40.761335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1201/2421] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:41.055765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ea1e-b455-4b61-9340-b215f3254536 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:41.058593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a6f2ea1e-b455-4b61-9340-b215f3254536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:41.073706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ea1e-b455-4b61-9340-b215f3254536 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:41.078937 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:41.079825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:41.080184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:41.080533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] PATH_INFO: `/v3/projects/b1bd87bb942841b7b16317fcfacf9d55` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:41.081820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1bd87bb942841b7b16317fcfacf9d55)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:41.083997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:41.101934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50df23-23c8-4503-8fb5-00bbf333d159 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:41.103414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-af50df23-23c8-4503-8fb5-00bbf333d159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:41.164421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1bd87bb942841b7b16317fcfacf9d55', 'request_id': 'req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.174949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1bd87bb942841b7b16317fcfacf9d55', 'request_id': 'req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.182547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1bd87bb942841b7b16317fcfacf9d55', 'request_id': 'req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.190589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50df23-23c8-4503-8fb5-00bbf333d159 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:41.198557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] The token cache is being invalidate because project b1bd87bb942841b7b16317fcfacf9d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:41.199165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.200557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.202407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1221/2422] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:41 2022] DELETE /identity/v3/projects/b1bd87bb942841b7b16317fcfacf9d55 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:41.206627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:41.208065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:41.270187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6df5a2-d230-4566-a198-f31e7e4b3280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:41.270832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df5a2-d230-4566-a198-f31e7e4b3280 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:41.271412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df5a2-d230-4566-a198-f31e7e4b3280 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:41.272262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df5a2-d230-4566-a198-f31e7e4b3280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:41.276260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7a6df5a2-d230-4566-a198-f31e7e4b3280 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:41.306475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312d4de-12e6-4ae3-8c50-42bb9ee2249c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:41.313851 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:41.314998 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:41.315338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:41.315620 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] PATH_INFO: `/v3/users/01cbdc45d79b49adba0709af24816b48` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:41.317904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cbdc45d79b49adba0709af24816b48)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:41.320250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:41.368322 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6df5a2-d230-4566-a198-f31e7e4b3280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:41.370566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6df5a2-d230-4566-a198-f31e7e4b3280 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:41.388564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1202/2423] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:41.389655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cbdc45d79b49adba0709af24816b48'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.390940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cbdc45d79b49adba0709af24816b48'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.391723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cbdc45d79b49adba0709af24816b48'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.402580 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cbdc45d79b49adba0709af24816b48'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.411815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-39ec1510-cbca-4c78-aa80-1447be878681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cbdc45d79b49adba0709af24816b48'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.425104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:41.441224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1222/2424] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:41 2022] DELETE /identity/v3/users/01cbdc45d79b49adba0709af24816b48 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:41.769455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6df5a2-d230-4566-a198-f31e7e4b3280 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:41.775085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:41.784263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6df5a2-d230-4566-a198-f31e7e4b3280 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:41.855290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:41.855931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:41.856209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:41.856481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] PATH_INFO: `/v3/projects/cd35765ccd3f48758a44848425eb057b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:41.857682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd35765ccd3f48758a44848425eb057b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:41.859629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:41.917739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd35765ccd3f48758a44848425eb057b', 'request_id': 'req-fd8bd7e2-f62c-402a-9e07-4470012e2884'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.926242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd35765ccd3f48758a44848425eb057b', 'request_id': 'req-fd8bd7e2-f62c-402a-9e07-4470012e2884'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.956164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd35765ccd3f48758a44848425eb057b', 'request_id': 'req-fd8bd7e2-f62c-402a-9e07-4470012e2884'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.969524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] The token cache is being invalidate because project cd35765ccd3f48758a44848425eb057b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:41.969910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.970665 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd8bd7e2-f62c-402a-9e07-4470012e2884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:41.972339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1203/2425] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:41 2022] DELETE /identity/v3/projects/cd35765ccd3f48758a44848425eb057b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:41.977213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bac8c-8405-46f3-9a3b-731b9295aea1 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:41.977619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bac8c-8405-46f3-9a3b-731b9295aea1 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:41.977988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bac8c-8405-46f3-9a3b-731b9295aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.001417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-bf5bac8c-8405-46f3-9a3b-731b9295aea1 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:42.002697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-bf5bac8c-8405-46f3-9a3b-731b9295aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:42.068424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1223/2426] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:42.076629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d3b6-f2ec-4be6-9f05-fceec5a71ecc None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.076918 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d3b6-f2ec-4be6-9f05-fceec5a71ecc None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.077193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21d3b6-f2ec-4be6-9f05-fceec5a71ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.100241 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ae21d3b6-f2ec-4be6-9f05-fceec5a71ecc None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:42.101517 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ae21d3b6-f2ec-4be6-9f05-fceec5a71ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:42.111160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1204/2427] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:42.115342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bac8c-8405-46f3-9a3b-731b9295aea1 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:42.126230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bac8c-8405-46f3-9a3b-731b9295aea1 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:42.131021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0bef-728a-405e-b9dd-85558b69f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:42.131647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0bef-728a-405e-b9dd-85558b69f415 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.131930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0bef-728a-405e-b9dd-85558b69f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.132201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0bef-728a-405e-b9dd-85558b69f415 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.132857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0bef-728a-405e-b9dd-85558b69f415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:42.133165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0bef-728a-405e-b9dd-85558b69f415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:42.135992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0bef-728a-405e-b9dd-85558b69f415 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:42.149384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1224/2428] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:51:42.154650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21d3b6-f2ec-4be6-9f05-fceec5a71ecc None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:42.164721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21d3b6-f2ec-4be6-9f05-fceec5a71ecc None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:42.170629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d31fa-e129-4dd5-ada7-e304fa65e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:42.171293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d31fa-e129-4dd5-ada7-e304fa65e613 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.171572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d31fa-e129-4dd5-ada7-e304fa65e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.171843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d31fa-e129-4dd5-ada7-e304fa65e613 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.172505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d31fa-e129-4dd5-ada7-e304fa65e613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:42.174461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d31fa-e129-4dd5-ada7-e304fa65e613 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:42.215220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1205/2429] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:42 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:42.216524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0bef-728a-405e-b9dd-85558b69f415 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:42.227985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0bef-728a-405e-b9dd-85558b69f415 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:42.323236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76bbd-925d-4275-8620-e2f892efeeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:42.323236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76bbd-925d-4275-8620-e2f892efeeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.323236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76bbd-925d-4275-8620-e2f892efeeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.323236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76bbd-925d-4275-8620-e2f892efeeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.324340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f76bbd-925d-4275-8620-e2f892efeeb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:42.324340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f76bbd-925d-4275-8620-e2f892efeeb8 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:42.359320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1225/2430] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:42 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:42.363209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d31fa-e129-4dd5-ada7-e304fa65e613 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:42.374954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d31fa-e129-4dd5-ada7-e304fa65e613 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:42.380357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa12ee-c2a7-4aec-ba99-496054f190e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:42.380994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa12ee-c2a7-4aec-ba99-496054f190e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.381245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa12ee-c2a7-4aec-ba99-496054f190e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.381514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa12ee-c2a7-4aec-ba99-496054f190e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.382150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa12ee-c2a7-4aec-ba99-496054f190e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:42.383769 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa12ee-c2a7-4aec-ba99-496054f190e0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:42.395659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1206/2431] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:51:42.399812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76bbd-925d-4275-8620-e2f892efeeb8 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:42.411010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76bbd-925d-4275-8620-e2f892efeeb8 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:42.416725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814a242-ae1e-4b31-9f1a-6a98d4ad7735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:42.417285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a242-ae1e-4b31-9f1a-6a98d4ad7735 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.417598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a242-ae1e-4b31-9f1a-6a98d4ad7735 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.417871 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a242-ae1e-4b31-9f1a-6a98d4ad7735 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.418801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814a242-ae1e-4b31-9f1a-6a98d4ad7735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:42.420706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814a242-ae1e-4b31-9f1a-6a98d4ad7735 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:42.442820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1226/2432] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:42.446081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa12ee-c2a7-4aec-ba99-496054f190e0 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:42.460386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa12ee-c2a7-4aec-ba99-496054f190e0 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:42.467105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c95a6b-9992-4f40-a680-cab335b25b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:42.467877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c95a6b-9992-4f40-a680-cab335b25b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.468752 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c95a6b-9992-4f40-a680-cab335b25b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.469045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c95a6b-9992-4f40-a680-cab335b25b68 admin admin] PATH_INFO: `/v3/projects/141169a932d049fe93a0fa2ab5db39ba/users/c2c8fe92e1f949d1b36c1e72cfc02acc/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.488859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c95a6b-9992-4f40-a680-cab335b25b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141169a932d049fe93a0fa2ab5db39ba, user_id=c2c8fe92e1f949d1b36c1e72cfc02acc, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:42.491776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c95a6b-9992-4f40-a680-cab335b25b68 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:42.509089 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1207/2433] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:42 2022] PUT /identity/v3/projects/141169a932d049fe93a0fa2ab5db39ba/users/c2c8fe92e1f949d1b36c1e72cfc02acc/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:42.524900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3980709-aecc-409a-8ffb-13bc0f9bf0ac None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.525188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3980709-aecc-409a-8ffb-13bc0f9bf0ac None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.525538 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3980709-aecc-409a-8ffb-13bc0f9bf0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.566695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b3980709-aecc-409a-8ffb-13bc0f9bf0ac None None] MFA Rules not processed for user `c2c8fe92e1f949d1b36c1e72cfc02acc`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:42.568666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b3980709-aecc-409a-8ffb-13bc0f9bf0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:42.635213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:42.642391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c95a6b-9992-4f40-a680-cab335b25b68 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:42.645059 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e2c95a6b-9992-4f40-a680-cab335b25b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:42.668948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1227/2434] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:42.673132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3980709-aecc-409a-8ffb-13bc0f9bf0ac None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:42.703520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:42.784140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c95a6b-9992-4f40-a680-cab335b25b68 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:42.785591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3980709-aecc-409a-8ffb-13bc0f9bf0ac None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:42.793138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e7419-e009-4f69-9c67-5a437074ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:42.793360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cb77c-c81b-487a-b229-7b2df492b647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:42.794086 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cb77c-c81b-487a-b229-7b2df492b647 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.794230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7419-e009-4f69-9c67-5a437074ca22 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.794509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cb77c-c81b-487a-b229-7b2df492b647 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.794648 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7419-e009-4f69-9c67-5a437074ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.794962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7419-e009-4f69-9c67-5a437074ca22 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.795100 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cb77c-c81b-487a-b229-7b2df492b647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.795880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e7419-e009-4f69-9c67-5a437074ca22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:42.797817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-224cb77c-c81b-487a-b229-7b2df492b647 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:42.798494 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e7419-e009-4f69-9c67-5a437074ca22 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:42.819757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cb77c-c81b-487a-b229-7b2df492b647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:42.821523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cb77c-c81b-487a-b229-7b2df492b647 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:42.844045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1228/2435] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:42 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:42.849695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e7419-e009-4f69-9c67-5a437074ca22 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:42.874830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1208/2436] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:42.942925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841edc8-88f9-48a5-890c-92cdb1f3f62b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:42.943360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841edc8-88f9-48a5-890c-92cdb1f3f62b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:42.943822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841edc8-88f9-48a5-890c-92cdb1f3f62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:42.979453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3841edc8-88f9-48a5-890c-92cdb1f3f62b None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:42.980987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3841edc8-88f9-48a5-890c-92cdb1f3f62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:43.033195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e7419-e009-4f69-9c67-5a437074ca22 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:43.040098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f445d-c65d-4b33-b35f-7ed22a7fc051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:43.041761 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f445d-c65d-4b33-b35f-7ed22a7fc051 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:43.042166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f445d-c65d-4b33-b35f-7ed22a7fc051 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:43.042444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f445d-c65d-4b33-b35f-7ed22a7fc051 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:43.043173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f445d-c65d-4b33-b35f-7ed22a7fc051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:43.045819 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f445d-c65d-4b33-b35f-7ed22a7fc051 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:43.079023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1229/2437] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:42 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:43.082986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f445d-c65d-4b33-b35f-7ed22a7fc051 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:43.083703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1209/2438] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:43.096670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841edc8-88f9-48a5-890c-92cdb1f3f62b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:43.099252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3841edc8-88f9-48a5-890c-92cdb1f3f62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:43.101153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f445d-c65d-4b33-b35f-7ed22a7fc051 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:43.112756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01bf79-5ff6-41fe-9de4-4517d878882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:43.113677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01bf79-5ff6-41fe-9de4-4517d878882e admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:43.114002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01bf79-5ff6-41fe-9de4-4517d878882e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:43.114335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01bf79-5ff6-41fe-9de4-4517d878882e admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:43.115161 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01bf79-5ff6-41fe-9de4-4517d878882e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:43.117745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01bf79-5ff6-41fe-9de4-4517d878882e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:43.130341 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1230/2439] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:43.136075 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01bf79-5ff6-41fe-9de4-4517d878882e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:43.148388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01bf79-5ff6-41fe-9de4-4517d878882e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:43.154308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d476-8290-47ff-b6b4-cd016fd1adcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:43.155005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d476-8290-47ff-b6b4-cd016fd1adcb admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:43.155291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d476-8290-47ff-b6b4-cd016fd1adcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:43.155571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d476-8290-47ff-b6b4-cd016fd1adcb admin admin] PATH_INFO: `/v3/projects/d1df434a5adb44e9acbf95eb62beb74a/users/a4e55afa102b40bb8015c5e618c9b0da/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:43.174485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d476-8290-47ff-b6b4-cd016fd1adcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1df434a5adb44e9acbf95eb62beb74a, user_id=a4e55afa102b40bb8015c5e618c9b0da, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:43.177265 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d476-8290-47ff-b6b4-cd016fd1adcb admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:43.193873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1231/2440] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:43 2022] PUT /identity/v3/projects/d1df434a5adb44e9acbf95eb62beb74a/users/a4e55afa102b40bb8015c5e618c9b0da/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:43.194151 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841edc8-88f9-48a5-890c-92cdb1f3f62b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:43.199190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d476-8290-47ff-b6b4-cd016fd1adcb admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:43.234736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:43.272664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:43.285691 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac83f4a-4eb6-4476-951d-59a409ec36e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:43.286410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac83f4a-4eb6-4476-951d-59a409ec36e5 service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:43.286802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac83f4a-4eb6-4476-951d-59a409ec36e5 service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:43.287188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac83f4a-4eb6-4476-951d-59a409ec36e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:43.288572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d476-8290-47ff-b6b4-cd016fd1adcb admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:43.296799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd91e9-0bbe-4af4-98c6-0b5ba17b6af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:43.298224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd91e9-0bbe-4af4-98c6-0b5ba17b6af7 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:43.298694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd91e9-0bbe-4af4-98c6-0b5ba17b6af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:43.299199 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd91e9-0bbe-4af4-98c6-0b5ba17b6af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:43.300313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd91e9-0bbe-4af4-98c6-0b5ba17b6af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:43.302243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd91e9-0bbe-4af4-98c6-0b5ba17b6af7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:43.319116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1232/2441] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:51:43.323642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd91e9-0bbe-4af4-98c6-0b5ba17b6af7 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:43.346973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd91e9-0bbe-4af4-98c6-0b5ba17b6af7 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:43.357679 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff275f7-4041-4fb2-864c-c1fffe369b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:43.363125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff275f7-4041-4fb2-864c-c1fffe369b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:43.363480 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff275f7-4041-4fb2-864c-c1fffe369b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:43.363779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff275f7-4041-4fb2-864c-c1fffe369b47 admin admin] PATH_INFO: `/v3/projects/d1df434a5adb44e9acbf95eb62beb74a/users/a4e55afa102b40bb8015c5e618c9b0da/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:43.369124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff275f7-4041-4fb2-864c-c1fffe369b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1df434a5adb44e9acbf95eb62beb74a, user_id=a4e55afa102b40bb8015c5e618c9b0da, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:43.370670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac83f4a-4eb6-4476-951d-59a409ec36e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:43.372547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac83f4a-4eb6-4476-951d-59a409ec36e5 service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:43.375900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff275f7-4041-4fb2-864c-c1fffe369b47 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:43.392339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1210/2442] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:51:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 11:51:43.393681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1233/2443] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:43 2022] PUT /identity/v3/projects/d1df434a5adb44e9acbf95eb62beb74a/users/a4e55afa102b40bb8015c5e618c9b0da/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:43.407390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7c88-ad61-4c67-a10a-ec04d5158d8e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:43.407791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7c88-ad61-4c67-a10a-ec04d5158d8e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:43.408170 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7c88-ad61-4c67-a10a-ec04d5158d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:43.453965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-8ecc7c88-ad61-4c67-a10a-ec04d5158d8e None None] MFA Rules not processed for user `a4e55afa102b40bb8015c5e618c9b0da`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:43.455330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8ecc7c88-ad61-4c67-a10a-ec04d5158d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:43.564755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1211/2444] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:43.576474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff275f7-4041-4fb2-864c-c1fffe369b47 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:43.578303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7ff275f7-4041-4fb2-864c-c1fffe369b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:43.659630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff275f7-4041-4fb2-864c-c1fffe369b47 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:43.663956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6a15-dde2-49e4-996e-1f33bd0cb883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:43.664765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6a15-dde2-49e4-996e-1f33bd0cb883 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:43.665150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6a15-dde2-49e4-996e-1f33bd0cb883 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:43.665515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6a15-dde2-49e4-996e-1f33bd0cb883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:43.756846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6a15-dde2-49e4-996e-1f33bd0cb883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:43.759257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b6a15-dde2-49e4-996e-1f33bd0cb883 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:43.770940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1234/2445] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:45.698158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7c88-ad61-4c67-a10a-ec04d5158d8e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:45.700445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8ecc7c88-ad61-4c67-a10a-ec04d5158d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:45.779703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7c88-ad61-4c67-a10a-ec04d5158d8e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:45.784425 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:45.785069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:45.785350 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:45.785623 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] PATH_INFO: `/v3/users/04b4b421f154438f9c372f32849161f8` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:45.786757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b4b421f154438f9c372f32849161f8)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:45.788836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:45.832189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:45.848188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b4b421f154438f9c372f32849161f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:45.857460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b4b421f154438f9c372f32849161f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:45.858205 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b4b421f154438f9c372f32849161f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:45.871101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b4b421f154438f9c372f32849161f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:45.871844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b4b421f154438f9c372f32849161f8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:45.885301 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1212/2446] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:45 2022] DELETE /identity/v3/users/04b4b421f154438f9c372f32849161f8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:45.889850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bab1ea-e38e-4b39-951d-ca8db79e6dab None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:45.890359 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bab1ea-e38e-4b39-951d-ca8db79e6dab None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:45.890468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bab1ea-e38e-4b39-951d-ca8db79e6dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:45.912217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f6bab1ea-e38e-4b39-951d-ca8db79e6dab None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:45.913440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f6bab1ea-e38e-4b39-951d-ca8db79e6dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:45.982209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1235/2447] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:45.992756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:45.995330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:46.058332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faac1fa-95f6-4a1c-b527-a4788ac59784 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:46.062096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d0953-b09b-43af-886a-9774aa81640b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:46.062715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d0953-b09b-43af-886a-9774aa81640b service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:46.063026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d0953-b09b-43af-886a-9774aa81640b service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:46.063302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d0953-b09b-43af-886a-9774aa81640b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:46.073580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d0953-b09b-43af-886a-9774aa81640b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:46.076592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d0953-b09b-43af-886a-9774aa81640b service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:46.085516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1213/2448] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:46.387943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bab1ea-e38e-4b39-951d-ca8db79e6dab None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:46.389670 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f6bab1ea-e38e-4b39-951d-ca8db79e6dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:46.403378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:46.409934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bab1ea-e38e-4b39-951d-ca8db79e6dab None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:46.423377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:46.424022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:46.424306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:46.424585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] PATH_INFO: `/v3/projects/31c36821322d411389edca69457f802c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:46.425764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c36821322d411389edca69457f802c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:46.427731 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:46.479562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c36821322d411389edca69457f802c', 'request_id': 'req-7993e901-635e-46d8-8712-d7c1eadade28'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.485739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c36821322d411389edca69457f802c', 'request_id': 'req-7993e901-635e-46d8-8712-d7c1eadade28'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.491361 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c36821322d411389edca69457f802c', 'request_id': 'req-7993e901-635e-46d8-8712-d7c1eadade28'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.503757 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] The token cache is being invalidate because project 31c36821322d411389edca69457f802c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:46.504048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.504669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.506157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1236/2449] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:46 2022] DELETE /identity/v3/projects/31c36821322d411389edca69457f802c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:46.510380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d0953-b09b-43af-886a-9774aa81640b service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:46.520071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d0953-b09b-43af-886a-9774aa81640b service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:46.577212 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:46.578113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:46.578390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:46.578658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] PATH_INFO: `/v3/users/4dc72db39a12411baceb1ed2da9642b6` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:46.579827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc72db39a12411baceb1ed2da9642b6)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:46.581712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:46.630296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc72db39a12411baceb1ed2da9642b6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.634880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:46.637894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc72db39a12411baceb1ed2da9642b6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.639087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc72db39a12411baceb1ed2da9642b6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.653063 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc72db39a12411baceb1ed2da9642b6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.653674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc72db39a12411baceb1ed2da9642b6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:46.668204 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1214/2450] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:46 2022] DELETE /identity/v3/users/4dc72db39a12411baceb1ed2da9642b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:46.962274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:46.964813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:46.980764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993e901-635e-46d8-8712-d7c1eadade28 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:47.047638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:47.048427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:47.048746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:47.049262 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] PATH_INFO: `/v3/projects/b9b8b1eec58449d78df5892f92859357` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:47.051306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b8b1eec58449d78df5892f92859357)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:47.053489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:47.107602 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b8b1eec58449d78df5892f92859357', 'request_id': 'req-dd0c9b39-ed88-4a81-b41f-b35cb8165270'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.114247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b8b1eec58449d78df5892f92859357', 'request_id': 'req-dd0c9b39-ed88-4a81-b41f-b35cb8165270'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.123124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b8b1eec58449d78df5892f92859357', 'request_id': 'req-dd0c9b39-ed88-4a81-b41f-b35cb8165270'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.138379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] The token cache is being invalidate because project b9b8b1eec58449d78df5892f92859357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:47.138792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.139900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.143684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1237/2451] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:46 2022] DELETE /identity/v3/projects/b9b8b1eec58449d78df5892f92859357 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:47.147458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:47.152029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:47.169194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6072e-7a09-44b1-bdbf-e28f1d42c63d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:47.232987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:47.233783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:47.234040 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:47.234310 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] PATH_INFO: `/v3/users/a31dcbc17bc44a7da2407b9805b992a8` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:47.235928 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31dcbc17bc44a7da2407b9805b992a8)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:47.238074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:47.294671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31dcbc17bc44a7da2407b9805b992a8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.303875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31dcbc17bc44a7da2407b9805b992a8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.303875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31dcbc17bc44a7da2407b9805b992a8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.317848 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31dcbc17bc44a7da2407b9805b992a8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.318561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-5b47f1cf-d3e2-4b6a-9cb6-5afce6b31a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31dcbc17bc44a7da2407b9805b992a8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.331437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1215/2452] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:47 2022] DELETE /identity/v3/users/a31dcbc17bc44a7da2407b9805b992a8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:47.638504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:47.640000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:47.662165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9b39-ed88-4a81-b41f-b35cb8165270 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:47.676969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:47.726236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:47.726904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:47.727212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:47.727492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] PATH_INFO: `/v3/projects/015f13ade2e74f7195a959c8fda440c7` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:47.729419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=015f13ade2e74f7195a959c8fda440c7)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:47.731373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:47.780403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015f13ade2e74f7195a959c8fda440c7', 'request_id': 'req-43c52283-13bb-49c2-aacc-9598dfb89555'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.786700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015f13ade2e74f7195a959c8fda440c7', 'request_id': 'req-43c52283-13bb-49c2-aacc-9598dfb89555'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.792992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015f13ade2e74f7195a959c8fda440c7', 'request_id': 'req-43c52283-13bb-49c2-aacc-9598dfb89555'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.805485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] The token cache is being invalidate because project 015f13ade2e74f7195a959c8fda440c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:47.805774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.807462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-43c52283-13bb-49c2-aacc-9598dfb89555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:47.809212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1238/2453] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:47 2022] DELETE /identity/v3/projects/015f13ade2e74f7195a959c8fda440c7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:47.814300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2b181-abbc-4891-90a2-a2473c99131a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:47.814594 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2b181-abbc-4891-90a2-a2473c99131a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:47.814914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2b181-abbc-4891-90a2-a2473c99131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:47.834512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-2bc2b181-abbc-4891-90a2-a2473c99131a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:47.835780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2bc2b181-abbc-4891-90a2-a2473c99131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:47.883263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:47.901064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1216/2454] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:47.910037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58eda4-bdf3-4efe-b11f-393162eba301 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:47.910321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58eda4-bdf3-4efe-b11f-393162eba301 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:47.910598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58eda4-bdf3-4efe-b11f-393162eba301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:47.932639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-8b58eda4-bdf3-4efe-b11f-393162eba301 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:47.933764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8b58eda4-bdf3-4efe-b11f-393162eba301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:47.941945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1239/2455] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:47.946128 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2b181-abbc-4891-90a2-a2473c99131a None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:47.956351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2b181-abbc-4891-90a2-a2473c99131a None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:47.961353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760232ec-7f8c-447c-8490-7acb520fa4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:47.961964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760232ec-7f8c-447c-8490-7acb520fa4bb admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:47.962300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760232ec-7f8c-447c-8490-7acb520fa4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:47.963101 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760232ec-7f8c-447c-8490-7acb520fa4bb admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:47.964386 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760232ec-7f8c-447c-8490-7acb520fa4bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:47.964696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760232ec-7f8c-447c-8490-7acb520fa4bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:47.966294 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760232ec-7f8c-447c-8490-7acb520fa4bb admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:47.979570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1217/2456] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:51:47.983992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58eda4-bdf3-4efe-b11f-393162eba301 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:47.993276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58eda4-bdf3-4efe-b11f-393162eba301 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:47.998644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3f5c2-cc57-4a67-8847-878d4dec42de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:47.999272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3f5c2-cc57-4a67-8847-878d4dec42de admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:47.999556 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3f5c2-cc57-4a67-8847-878d4dec42de admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:47.999830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3f5c2-cc57-4a67-8847-878d4dec42de admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.000455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3f5c2-cc57-4a67-8847-878d4dec42de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.002354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3f5c2-cc57-4a67-8847-878d4dec42de admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.036401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1240/2457] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:47 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:48.041650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760232ec-7f8c-447c-8490-7acb520fa4bb admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.053055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760232ec-7f8c-447c-8490-7acb520fa4bb admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.111575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81503b5-270d-4b8d-bb8f-aef43d01e175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.112184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81503b5-270d-4b8d-bb8f-aef43d01e175 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.112467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81503b5-270d-4b8d-bb8f-aef43d01e175 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.112741 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81503b5-270d-4b8d-bb8f-aef43d01e175 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.113397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81503b5-270d-4b8d-bb8f-aef43d01e175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.115402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81503b5-270d-4b8d-bb8f-aef43d01e175 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.136938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1218/2458] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:48 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:48.141451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3f5c2-cc57-4a67-8847-878d4dec42de admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.152432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3f5c2-cc57-4a67-8847-878d4dec42de admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.157093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df1ab4-e809-42f4-9458-afe73cd6d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.157695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df1ab4-e809-42f4-9458-afe73cd6d079 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.157968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df1ab4-e809-42f4-9458-afe73cd6d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.158236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df1ab4-e809-42f4-9458-afe73cd6d079 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.158911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df1ab4-e809-42f4-9458-afe73cd6d079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.160500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df1ab4-e809-42f4-9458-afe73cd6d079 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.171223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1241/2459] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:48.175282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81503b5-270d-4b8d-bb8f-aef43d01e175 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.185699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81503b5-270d-4b8d-bb8f-aef43d01e175 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.190336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf91fb3-6fed-4398-a59f-63b15f4f7f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.190980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91fb3-6fed-4398-a59f-63b15f4f7f9f admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.191264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91fb3-6fed-4398-a59f-63b15f4f7f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.191539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91fb3-6fed-4398-a59f-63b15f4f7f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.192184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf91fb3-6fed-4398-a59f-63b15f4f7f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.193766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf91fb3-6fed-4398-a59f-63b15f4f7f9f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.208441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1219/2460] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:48.210917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df1ab4-e809-42f4-9458-afe73cd6d079 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.221549 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df1ab4-e809-42f4-9458-afe73cd6d079 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.226282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6340a-aefa-4cc4-b4df-201db03b6531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.227133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6340a-aefa-4cc4-b4df-201db03b6531 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.227555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6340a-aefa-4cc4-b4df-201db03b6531 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.227898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6340a-aefa-4cc4-b4df-201db03b6531 admin admin] PATH_INFO: `/v3/projects/e0bfaf52290946e483a4aa1d83867d0e/users/8eb3d3089a544152a7e53bcb29c36d8d/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.243821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6340a-aefa-4cc4-b4df-201db03b6531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bfaf52290946e483a4aa1d83867d0e, user_id=8eb3d3089a544152a7e53bcb29c36d8d, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.246543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6340a-aefa-4cc4-b4df-201db03b6531 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.261353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1242/2461] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:48 2022] PUT /identity/v3/projects/e0bfaf52290946e483a4aa1d83867d0e/users/8eb3d3089a544152a7e53bcb29c36d8d/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:48.271996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d5156-116d-4ead-af01-a7928273dd4d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.272280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d5156-116d-4ead-af01-a7928273dd4d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.272553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d5156-116d-4ead-af01-a7928273dd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.302191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-a67d5156-116d-4ead-af01-a7928273dd4d None None] MFA Rules not processed for user `8eb3d3089a544152a7e53bcb29c36d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:48.303510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a67d5156-116d-4ead-af01-a7928273dd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:48.315242 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6340a-aefa-4cc4-b4df-201db03b6531 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.316974 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-bdb6340a-aefa-4cc4-b4df-201db03b6531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:48.374637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:48.391246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6340a-aefa-4cc4-b4df-201db03b6531 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.396146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e6ea-59a4-4b28-9cbc-44af062d772c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.396328 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1220/2462] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:48.397127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e6ea-59a4-4b28-9cbc-44af062d772c service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.397749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e6ea-59a4-4b28-9cbc-44af062d772c service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.398296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e6ea-59a4-4b28-9cbc-44af062d772c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.400278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5ca3e6ea-59a4-4b28-9cbc-44af062d772c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:48.400733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d5156-116d-4ead-af01-a7928273dd4d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.448807 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:48.469264 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d5156-116d-4ead-af01-a7928273dd4d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.472808 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3e6ea-59a4-4b28-9cbc-44af062d772c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.474119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b65c-e10d-4208-a8a8-330dc7407311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.474292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3e6ea-59a4-4b28-9cbc-44af062d772c service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.474898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b65c-e10d-4208-a8a8-330dc7407311 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.475183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b65c-e10d-4208-a8a8-330dc7407311 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.475453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b65c-e10d-4208-a8a8-330dc7407311 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.476108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b65c-e10d-4208-a8a8-330dc7407311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.477978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b65c-e10d-4208-a8a8-330dc7407311 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.484879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1243/2463] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:48.514214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1221/2464] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:48 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:48.515855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e6ea-59a4-4b28-9cbc-44af062d772c service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.527065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e6ea-59a4-4b28-9cbc-44af062d772c service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.603751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aea0b-810e-4e5b-9d05-05721ff9c5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.603751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aea0b-810e-4e5b-9d05-05721ff9c5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.603751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aea0b-810e-4e5b-9d05-05721ff9c5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.603751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aea0b-810e-4e5b-9d05-05721ff9c5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.605904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aea0b-810e-4e5b-9d05-05721ff9c5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.605904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aea0b-810e-4e5b-9d05-05721ff9c5f8 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.643201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1244/2465] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:48 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:48.644619 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b65c-e10d-4208-a8a8-330dc7407311 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.659923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b65c-e10d-4208-a8a8-330dc7407311 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.661581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aea0b-810e-4e5b-9d05-05721ff9c5f8 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.663887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-506aea0b-810e-4e5b-9d05-05721ff9c5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:48.668087 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02463f38-09d0-4bc4-a6ad-3fd45a963719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.668793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02463f38-09d0-4bc4-a6ad-3fd45a963719 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.669159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02463f38-09d0-4bc4-a6ad-3fd45a963719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.669438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02463f38-09d0-4bc4-a6ad-3fd45a963719 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.670180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02463f38-09d0-4bc4-a6ad-3fd45a963719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.671986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02463f38-09d0-4bc4-a6ad-3fd45a963719 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.687716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1222/2466] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:51:48.688651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02463f38-09d0-4bc4-a6ad-3fd45a963719 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.698971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02463f38-09d0-4bc4-a6ad-3fd45a963719 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.706142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656d778-8d92-47b6-88cc-40d0496d5f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.707045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656d778-8d92-47b6-88cc-40d0496d5f78 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.707333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656d778-8d92-47b6-88cc-40d0496d5f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.707607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656d778-8d92-47b6-88cc-40d0496d5f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.708254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656d778-8d92-47b6-88cc-40d0496d5f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.709914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656d778-8d92-47b6-88cc-40d0496d5f78 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.721703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1223/2467] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:48.725836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656d778-8d92-47b6-88cc-40d0496d5f78 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:48.734828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aea0b-810e-4e5b-9d05-05721ff9c5f8 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.739517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e1bc8-4d24-4fa5-a258-531d71994d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.740133 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656d778-8d92-47b6-88cc-40d0496d5f78 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:48.740266 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e1bc8-4d24-4fa5-a258-531d71994d39 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.740452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e1bc8-4d24-4fa5-a258-531d71994d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.740904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e1bc8-4d24-4fa5-a258-531d71994d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.742666 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-979e1bc8-4d24-4fa5-a258-531d71994d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:48.746984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b9510-e303-4477-a65c-ee7e75d07621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:48.747963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b9510-e303-4477-a65c-ee7e75d07621 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.748478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b9510-e303-4477-a65c-ee7e75d07621 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.748782 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b9510-e303-4477-a65c-ee7e75d07621 admin admin] PATH_INFO: `/v3/projects/4a439f9ebb25487882ba2e843ca5de43/users/8a4d8f2993c644b193d5de0752d257ea/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.757018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e1bc8-4d24-4fa5-a258-531d71994d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.758743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e1bc8-4d24-4fa5-a258-531d71994d39 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.769615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b9510-e303-4477-a65c-ee7e75d07621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a439f9ebb25487882ba2e843ca5de43, user_id=8a4d8f2993c644b193d5de0752d257ea, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:48.784051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b9510-e303-4477-a65c-ee7e75d07621 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:48.784396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1245/2468] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:51:48.807540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1224/2469] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:48 2022] PUT /identity/v3/projects/4a439f9ebb25487882ba2e843ca5de43/users/8a4d8f2993c644b193d5de0752d257ea/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:48.811950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df1c15-4d50-4a07-b888-0c32397a11cf None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:48.812432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df1c15-4d50-4a07-b888-0c32397a11cf None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:48.812804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df1c15-4d50-4a07-b888-0c32397a11cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:48.868024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c5df1c15-4d50-4a07-b888-0c32397a11cf None None] MFA Rules not processed for user `8a4d8f2993c644b193d5de0752d257ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:48.870355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c5df1c15-4d50-4a07-b888-0c32397a11cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:48.883981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:48.961705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1246/2470] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:48.966595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b9510-e303-4477-a65c-ee7e75d07621 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:49.031007 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b9510-e303-4477-a65c-ee7e75d07621 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:49.036622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc493-1553-4b1d-97e6-aee2414f0de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:49.037244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc493-1553-4b1d-97e6-aee2414f0de5 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:49.037521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc493-1553-4b1d-97e6-aee2414f0de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:49.037872 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc493-1553-4b1d-97e6-aee2414f0de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:49.038437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bc493-1553-4b1d-97e6-aee2414f0de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:49.040390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bc493-1553-4b1d-97e6-aee2414f0de5 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:49.073490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1225/2471] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:48 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:49.077417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df1c15-4d50-4a07-b888-0c32397a11cf None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:49.088874 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df1c15-4d50-4a07-b888-0c32397a11cf None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:49.153086 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d08e2-800c-426f-8aec-a8aebf0b6c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:49.153734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d08e2-800c-426f-8aec-a8aebf0b6c53 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:49.154012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d08e2-800c-426f-8aec-a8aebf0b6c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:49.154285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d08e2-800c-426f-8aec-a8aebf0b6c53 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:49.154942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d08e2-800c-426f-8aec-a8aebf0b6c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:49.157305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d08e2-800c-426f-8aec-a8aebf0b6c53 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:49.178504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1247/2472] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:49 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:49.182590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc493-1553-4b1d-97e6-aee2414f0de5 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:49.192980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc493-1553-4b1d-97e6-aee2414f0de5 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:49.198380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b73a-c4b3-4921-988f-66b7f3c08817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:49.199016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b73a-c4b3-4921-988f-66b7f3c08817 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:49.199299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b73a-c4b3-4921-988f-66b7f3c08817 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:49.199588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b73a-c4b3-4921-988f-66b7f3c08817 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:49.200213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62b73a-c4b3-4921-988f-66b7f3c08817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:49.201809 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62b73a-c4b3-4921-988f-66b7f3c08817 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:49.213669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1226/2473] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:49.217829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d08e2-800c-426f-8aec-a8aebf0b6c53 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:49.227779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d08e2-800c-426f-8aec-a8aebf0b6c53 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:49.233465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfc171-6d62-43d6-8609-6d7821c86313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:49.234152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfc171-6d62-43d6-8609-6d7821c86313 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:49.234634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfc171-6d62-43d6-8609-6d7821c86313 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:49.234952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfc171-6d62-43d6-8609-6d7821c86313 admin admin] PATH_INFO: `/v3/projects/34182560fb2a4e5c8f188ec2091908ee/users/a6a9b564fef34ae1bf115be5d818ee1d/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:49.251435 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfc171-6d62-43d6-8609-6d7821c86313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34182560fb2a4e5c8f188ec2091908ee, user_id=a6a9b564fef34ae1bf115be5d818ee1d, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:49.254171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfc171-6d62-43d6-8609-6d7821c86313 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:49.268360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1248/2474] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:49 2022] PUT /identity/v3/projects/34182560fb2a4e5c8f188ec2091908ee/users/a6a9b564fef34ae1bf115be5d818ee1d/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:49.272609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b73a-c4b3-4921-988f-66b7f3c08817 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:49.283569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b73a-c4b3-4921-988f-66b7f3c08817 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:49.339514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:49.346639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35d3ea-1e9f-4aaa-a90d-647c5d14ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:49.347424 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d3ea-1e9f-4aaa-a90d-647c5d14ae1e admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:49.347704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d3ea-1e9f-4aaa-a90d-647c5d14ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:49.347976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d3ea-1e9f-4aaa-a90d-647c5d14ae1e admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:49.348614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35d3ea-1e9f-4aaa-a90d-647c5d14ae1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:49.350206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35d3ea-1e9f-4aaa-a90d-647c5d14ae1e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:49.364721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1227/2475] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:51:49.365959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfc171-6d62-43d6-8609-6d7821c86313 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:49.377513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfc171-6d62-43d6-8609-6d7821c86313 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:49.382239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89bd1-d30b-4b69-99fb-11f77c7d29f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:49.382924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89bd1-d30b-4b69-99fb-11f77c7d29f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:49.383212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89bd1-d30b-4b69-99fb-11f77c7d29f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:49.383486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89bd1-d30b-4b69-99fb-11f77c7d29f3 admin admin] PATH_INFO: `/v3/projects/34182560fb2a4e5c8f188ec2091908ee/users/a6a9b564fef34ae1bf115be5d818ee1d/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:49.386326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d89bd1-d30b-4b69-99fb-11f77c7d29f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34182560fb2a4e5c8f188ec2091908ee, user_id=a6a9b564fef34ae1bf115be5d818ee1d, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:49.392182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d89bd1-d30b-4b69-99fb-11f77c7d29f3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:49.404701 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1249/2476] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:49 2022] PUT /identity/v3/projects/34182560fb2a4e5c8f188ec2091908ee/users/a6a9b564fef34ae1bf115be5d818ee1d/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:49.416270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e3e1f-0a95-4ad4-b07e-57562f4686b1 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:49.416608 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e3e1f-0a95-4ad4-b07e-57562f4686b1 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:49.416889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e3e1f-0a95-4ad4-b07e-57562f4686b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:49.447046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d51e3e1f-0a95-4ad4-b07e-57562f4686b1 None None] MFA Rules not processed for user `a6a9b564fef34ae1bf115be5d818ee1d`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:49.448503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d51e3e1f-0a95-4ad4-b07e-57562f4686b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:49.520753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1228/2477] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:49.533402 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89bd1-d30b-4b69-99fb-11f77c7d29f3 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:49.594303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89bd1-d30b-4b69-99fb-11f77c7d29f3 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:49.598022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205503ae-8f00-4bcf-b30f-80e645970bf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:49.598637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205503ae-8f00-4bcf-b30f-80e645970bf1 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:49.598981 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205503ae-8f00-4bcf-b30f-80e645970bf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:49.599227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205503ae-8f00-4bcf-b30f-80e645970bf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:49.620342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:49.662431 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205503ae-8f00-4bcf-b30f-80e645970bf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:49.664211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205503ae-8f00-4bcf-b30f-80e645970bf1 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:49.674728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1250/2478] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:51.287864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e3e1f-0a95-4ad4-b07e-57562f4686b1 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:51.289420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d51e3e1f-0a95-4ad4-b07e-57562f4686b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:51.306732 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e3e1f-0a95-4ad4-b07e-57562f4686b1 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:51.312957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b3c12-f61e-4e40-b1de-9069785a4c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:51.313738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3c12-f61e-4e40-b1de-9069785a4c05 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:51.314088 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3c12-f61e-4e40-b1de-9069785a4c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:51.314426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3c12-f61e-4e40-b1de-9069785a4c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:51.416857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b3c12-f61e-4e40-b1de-9069785a4c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:51.418463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b3c12-f61e-4e40-b1de-9069785a4c05 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:51.428832 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1229/2479] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:52.046213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205503ae-8f00-4bcf-b30f-80e645970bf1 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:52.048253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-205503ae-8f00-4bcf-b30f-80e645970bf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:52.126251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b3c12-f61e-4e40-b1de-9069785a4c05 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:52.126442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205503ae-8f00-4bcf-b30f-80e645970bf1 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:52.131739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:52.132591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:52.132925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:52.133271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] PATH_INFO: `/v3/users/a066d4114d3b438cacd7437966d17c66` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:52.135693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a066d4114d3b438cacd7437966d17c66)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:52.135951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b3c12-f61e-4e40-b1de-9069785a4c05 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:52.137669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:52.139866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190632a-0cb2-4241-94ba-1c10911edd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:52.141138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190632a-0cb2-4241-94ba-1c10911edd6f service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:52.141138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190632a-0cb2-4241-94ba-1c10911edd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:52.141474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190632a-0cb2-4241-94ba-1c10911edd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:52.151699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190632a-0cb2-4241-94ba-1c10911edd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:52.153249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190632a-0cb2-4241-94ba-1c10911edd6f service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:52.166351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1230/2480] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:51:52.202921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a066d4114d3b438cacd7437966d17c66'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.203743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a066d4114d3b438cacd7437966d17c66'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.204420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a066d4114d3b438cacd7437966d17c66'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.214286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a066d4114d3b438cacd7437966d17c66'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.223035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e5c16ec2-f6da-419e-bc2b-68188db7dff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a066d4114d3b438cacd7437966d17c66'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.246743 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1251/2481] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:52 2022] DELETE /identity/v3/users/a066d4114d3b438cacd7437966d17c66 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:52.441460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190632a-0cb2-4241-94ba-1c10911edd6f service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:52.454422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190632a-0cb2-4241-94ba-1c10911edd6f service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:52.525431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:52.526575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:52.527054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:52.527335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] PATH_INFO: `/v3/projects/692af88d80d94882ab926cf88e58d24b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:52.528572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=692af88d80d94882ab926cf88e58d24b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:52.530831 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:52.539683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:52.588185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692af88d80d94882ab926cf88e58d24b', 'request_id': 'req-11376f5c-f660-4899-8442-8a3e862e9770'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.596191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692af88d80d94882ab926cf88e58d24b', 'request_id': 'req-11376f5c-f660-4899-8442-8a3e862e9770'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.602407 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692af88d80d94882ab926cf88e58d24b', 'request_id': 'req-11376f5c-f660-4899-8442-8a3e862e9770'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.614499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] The token cache is being invalidate because project 692af88d80d94882ab926cf88e58d24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:52.614813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.615464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-11376f5c-f660-4899-8442-8a3e862e9770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:52.616944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1231/2482] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:52 2022] DELETE /identity/v3/projects/692af88d80d94882ab926cf88e58d24b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:52.622462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cbbe2-fccb-4c6e-85ec-248a8747eb3e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:52.622751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cbbe2-fccb-4c6e-85ec-248a8747eb3e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:52.623070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cbbe2-fccb-4c6e-85ec-248a8747eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:52.643565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-787cbbe2-fccb-4c6e-85ec-248a8747eb3e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:52.644777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-787cbbe2-fccb-4c6e-85ec-248a8747eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:52.681901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:52.708813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1252/2483] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:52.718150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c706f4e-de89-4cea-9335-0b491b007764 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:52.718439 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c706f4e-de89-4cea-9335-0b491b007764 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:52.718720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c706f4e-de89-4cea-9335-0b491b007764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:52.739223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4c706f4e-de89-4cea-9335-0b491b007764 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:52.740438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4c706f4e-de89-4cea-9335-0b491b007764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:52.748617 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1232/2484] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:52.752912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cbbe2-fccb-4c6e-85ec-248a8747eb3e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:52.763422 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cbbe2-fccb-4c6e-85ec-248a8747eb3e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:52.768299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5323339-8705-4148-9f56-24e7292af3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:52.768900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5323339-8705-4148-9f56-24e7292af3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:52.769180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5323339-8705-4148-9f56-24e7292af3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:52.769449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5323339-8705-4148-9f56-24e7292af3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:52.770114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5323339-8705-4148-9f56-24e7292af3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:52.770418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5323339-8705-4148-9f56-24e7292af3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:52.772026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5323339-8705-4148-9f56-24e7292af3b9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:52.784961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1253/2485] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:51:52.789528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c706f4e-de89-4cea-9335-0b491b007764 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:52.799197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c706f4e-de89-4cea-9335-0b491b007764 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:52.803908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4d9fb-4f6d-4c20-9b8a-a70104793e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:52.804451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4d9fb-4f6d-4c20-9b8a-a70104793e96 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:52.804727 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4d9fb-4f6d-4c20-9b8a-a70104793e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:52.804994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4d9fb-4f6d-4c20-9b8a-a70104793e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:52.805609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4d9fb-4f6d-4c20-9b8a-a70104793e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:52.807531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4d9fb-4f6d-4c20-9b8a-a70104793e96 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:52.835505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1233/2486] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:52 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:52.851723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5323339-8705-4148-9f56-24e7292af3b9 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:52.871533 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5323339-8705-4148-9f56-24e7292af3b9 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:52.931267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6493-4bea-4c6a-8147-a4b8c6d9bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:52.931919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6493-4bea-4c6a-8147-a4b8c6d9bdff admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:52.932197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6493-4bea-4c6a-8147-a4b8c6d9bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:52.932467 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6493-4bea-4c6a-8147-a4b8c6d9bdff admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:52.933089 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6493-4bea-4c6a-8147-a4b8c6d9bdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:52.935032 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6493-4bea-4c6a-8147-a4b8c6d9bdff admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:52.957195 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1254/2487] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:52 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:52.961397 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4d9fb-4f6d-4c20-9b8a-a70104793e96 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:52.972804 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4d9fb-4f6d-4c20-9b8a-a70104793e96 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:52.977699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8419bb-80cd-401b-bf44-7390f2bb5399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:52.978307 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8419bb-80cd-401b-bf44-7390f2bb5399 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:52.978590 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8419bb-80cd-401b-bf44-7390f2bb5399 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:52.978902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8419bb-80cd-401b-bf44-7390f2bb5399 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:52.979577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8419bb-80cd-401b-bf44-7390f2bb5399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:52.981210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8419bb-80cd-401b-bf44-7390f2bb5399 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:52.991658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1234/2488] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:52.996303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6493-4bea-4c6a-8147-a4b8c6d9bdff admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:53.006838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6493-4bea-4c6a-8147-a4b8c6d9bdff admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:53.012667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b041a-4ee0-4ce6-b179-56dc731ddd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:53.013263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b041a-4ee0-4ce6-b179-56dc731ddd21 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:53.013555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b041a-4ee0-4ce6-b179-56dc731ddd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:53.013830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b041a-4ee0-4ce6-b179-56dc731ddd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:53.014474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b041a-4ee0-4ce6-b179-56dc731ddd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:53.016372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b041a-4ee0-4ce6-b179-56dc731ddd21 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:53.028497 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1255/2489] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:53.032704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8419bb-80cd-401b-bf44-7390f2bb5399 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:53.042877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8419bb-80cd-401b-bf44-7390f2bb5399 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:53.047668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e4ad-d469-48ff-a70e-02b05e8582a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:53.048325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e4ad-d469-48ff-a70e-02b05e8582a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:53.048613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e4ad-d469-48ff-a70e-02b05e8582a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:53.048887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e4ad-d469-48ff-a70e-02b05e8582a3 admin admin] PATH_INFO: `/v3/projects/0d90d6febfca496f9749bb41f010f027/users/048048286a734cdc83805fe78cc821e7/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:53.063817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277e4ad-d469-48ff-a70e-02b05e8582a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d90d6febfca496f9749bb41f010f027, user_id=048048286a734cdc83805fe78cc821e7, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:53.066402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277e4ad-d469-48ff-a70e-02b05e8582a3 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:53.080367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1235/2490] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:53 2022] PUT /identity/v3/projects/0d90d6febfca496f9749bb41f010f027/users/048048286a734cdc83805fe78cc821e7/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:53.091571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e5afa-572d-48c0-850f-88f03ffba56d None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:53.091571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e5afa-572d-48c0-850f-88f03ffba56d None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:53.092150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e5afa-572d-48c0-850f-88f03ffba56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:53.120590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-182e5afa-572d-48c0-850f-88f03ffba56d None None] MFA Rules not processed for user `048048286a734cdc83805fe78cc821e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:53.121821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-182e5afa-572d-48c0-850f-88f03ffba56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:53.187758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1256/2491] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:53.200177 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e4ad-d469-48ff-a70e-02b05e8582a3 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:53.201901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2277e4ad-d469-48ff-a70e-02b05e8582a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:53.277060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e4ad-d469-48ff-a70e-02b05e8582a3 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:53.282847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9cfa6-a0cd-42d6-a9df-547ac8bc9dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:53.283463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cfa6-a0cd-42d6-a9df-547ac8bc9dd3 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:53.283748 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cfa6-a0cd-42d6-a9df-547ac8bc9dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:53.284023 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cfa6-a0cd-42d6-a9df-547ac8bc9dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:53.292938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9cfa6-a0cd-42d6-a9df-547ac8bc9dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:53.294526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9cfa6-a0cd-42d6-a9df-547ac8bc9dd3 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:53.304198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1236/2492] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:53.598374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e5afa-572d-48c0-850f-88f03ffba56d None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:53.599927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-182e5afa-572d-48c0-850f-88f03ffba56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:53.664980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:53.705133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e5afa-572d-48c0-850f-88f03ffba56d None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:53.710606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:53.711299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:53.711583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:53.714063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] PATH_INFO: `/v3/users/c2c8fe92e1f949d1b36c1e72cfc02acc` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:53.715282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c8fe92e1f949d1b36c1e72cfc02acc)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:53.717451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:53.773180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c8fe92e1f949d1b36c1e72cfc02acc'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:53.773869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c8fe92e1f949d1b36c1e72cfc02acc'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:53.774518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c8fe92e1f949d1b36c1e72cfc02acc'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:53.782227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c8fe92e1f949d1b36c1e72cfc02acc'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:53.789838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c8fe92e1f949d1b36c1e72cfc02acc'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:53.808660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1257/2493] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:53 2022] DELETE /identity/v3/users/c2c8fe92e1f949d1b36c1e72cfc02acc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:53.813200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af646c9-63c2-42b2-a740-c42c8ad6a196 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:53.813719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af646c9-63c2-42b2-a740-c42c8ad6a196 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:53.813821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af646c9-63c2-42b2-a740-c42c8ad6a196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:53.833786 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-2af646c9-63c2-42b2-a740-c42c8ad6a196 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:53.834955 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2af646c9-63c2-42b2-a740-c42c8ad6a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:53.846035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:53.900766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1237/2494] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:53.910536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:53.911980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:53.974274 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aa322-b74c-4005-adeb-41bec74aa6c9 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:53.979007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a12c81-cc6d-461d-8ab8-bb1551710441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:53.979640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a12c81-cc6d-461d-8ab8-bb1551710441 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:53.979930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a12c81-cc6d-461d-8ab8-bb1551710441 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:53.980205 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a12c81-cc6d-461d-8ab8-bb1551710441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:53.989377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a12c81-cc6d-461d-8ab8-bb1551710441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:53.990838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a12c81-cc6d-461d-8ab8-bb1551710441 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:54.001055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1258/2495] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:54.300153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af646c9-63c2-42b2-a740-c42c8ad6a196 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:54.301669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2af646c9-63c2-42b2-a740-c42c8ad6a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:54.319699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af646c9-63c2-42b2-a740-c42c8ad6a196 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:54.326075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:54.326925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:54.327288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:54.327664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] PATH_INFO: `/v3/projects/141169a932d049fe93a0fa2ab5db39ba` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:54.329211 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=141169a932d049fe93a0fa2ab5db39ba)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:54.331572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:54.382131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141169a932d049fe93a0fa2ab5db39ba', 'request_id': 'req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.389109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141169a932d049fe93a0fa2ab5db39ba', 'request_id': 'req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.395050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141169a932d049fe93a0fa2ab5db39ba', 'request_id': 'req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.406039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] The token cache is being invalidate because project 141169a932d049fe93a0fa2ab5db39ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:54.406357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.406979 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.408468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1238/2496] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:54 2022] DELETE /identity/v3/projects/141169a932d049fe93a0fa2ab5db39ba => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:54.412565 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a12c81-cc6d-461d-8ab8-bb1551710441 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:54.422896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a12c81-cc6d-461d-8ab8-bb1551710441 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:54.472969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:54.480306 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:54.480949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:54.481559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:54.481872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] PATH_INFO: `/v3/users/a4e55afa102b40bb8015c5e618c9b0da` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:54.483228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e55afa102b40bb8015c5e618c9b0da)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:54.485517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:54.530801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e55afa102b40bb8015c5e618c9b0da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.531428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e55afa102b40bb8015c5e618c9b0da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.532020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e55afa102b40bb8015c5e618c9b0da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.538829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e55afa102b40bb8015c5e618c9b0da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.548038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-02e23ca8-90e1-4bcf-8af7-de834fdb691e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e55afa102b40bb8015c5e618c9b0da'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:54.565793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1259/2497] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:54 2022] DELETE /identity/v3/users/a4e55afa102b40bb8015c5e618c9b0da => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:54.881071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:54.882745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:54.913724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c8691-63bc-4529-97e4-f81dc6a5b98d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:55.003286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:55.004530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.004828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.005110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] PATH_INFO: `/v3/projects/d1df434a5adb44e9acbf95eb62beb74a` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.006393 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1df434a5adb44e9acbf95eb62beb74a)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:55.010796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:55.069719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:55.080261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1df434a5adb44e9acbf95eb62beb74a', 'request_id': 'req-b8999507-443c-4bb3-a953-6830b1d983f6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:55.090482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1df434a5adb44e9acbf95eb62beb74a', 'request_id': 'req-b8999507-443c-4bb3-a953-6830b1d983f6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:55.096556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1df434a5adb44e9acbf95eb62beb74a', 'request_id': 'req-b8999507-443c-4bb3-a953-6830b1d983f6'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:55.108244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] The token cache is being invalidate because project d1df434a5adb44e9acbf95eb62beb74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:55.108541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:55.109302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b8999507-443c-4bb3-a953-6830b1d983f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:55.110974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1239/2498] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:54 2022] DELETE /identity/v3/projects/d1df434a5adb44e9acbf95eb62beb74a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:55.117812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d37a-ff7c-4373-bfaa-b61cbd0307df None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.118210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d37a-ff7c-4373-bfaa-b61cbd0307df None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.118570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d37a-ff7c-4373-bfaa-b61cbd0307df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.139442 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d0e7d37a-ff7c-4373-bfaa-b61cbd0307df None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:55.140916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d0e7d37a-ff7c-4373-bfaa-b61cbd0307df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:55.205804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1260/2499] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:55.216887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1386-c5ca-4081-bbf7-9469f10efedf None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.217260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1386-c5ca-4081-bbf7-9469f10efedf None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.217564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1386-c5ca-4081-bbf7-9469f10efedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.240300 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ca2d1386-c5ca-4081-bbf7-9469f10efedf None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:55.241523 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ca2d1386-c5ca-4081-bbf7-9469f10efedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:55.249936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1240/2500] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:55.254391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d37a-ff7c-4373-bfaa-b61cbd0307df None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:55.266719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d37a-ff7c-4373-bfaa-b61cbd0307df None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:55.272566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10df79-c938-4e82-84a7-180b2e21acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:55.273237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10df79-c938-4e82-84a7-180b2e21acb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.273590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10df79-c938-4e82-84a7-180b2e21acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.274078 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10df79-c938-4e82-84a7-180b2e21acb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.275759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10df79-c938-4e82-84a7-180b2e21acb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:55.276132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10df79-c938-4e82-84a7-180b2e21acb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:55.277930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10df79-c938-4e82-84a7-180b2e21acb6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:55.291218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1261/2501] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:51:55.295742 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d1386-c5ca-4081-bbf7-9469f10efedf None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:55.304942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d1386-c5ca-4081-bbf7-9469f10efedf None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:55.310719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa87d-7331-46cb-bac9-293ff3c7aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:55.311357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa87d-7331-46cb-bac9-293ff3c7aca8 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.311663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa87d-7331-46cb-bac9-293ff3c7aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.311938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa87d-7331-46cb-bac9-293ff3c7aca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.312564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aa87d-7331-46cb-bac9-293ff3c7aca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:55.314471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aa87d-7331-46cb-bac9-293ff3c7aca8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:55.342704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1241/2502] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:55 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:51:55.347289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10df79-c938-4e82-84a7-180b2e21acb6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:55.358732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10df79-c938-4e82-84a7-180b2e21acb6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:55.422046 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a20f31-87bc-47bc-ab94-55ece01e6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:55.422706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a20f31-87bc-47bc-ab94-55ece01e6e80 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.422961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a20f31-87bc-47bc-ab94-55ece01e6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.423239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a20f31-87bc-47bc-ab94-55ece01e6e80 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.423883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a20f31-87bc-47bc-ab94-55ece01e6e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:55.425853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a20f31-87bc-47bc-ab94-55ece01e6e80 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:55.436010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:55.448724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1262/2503] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:55 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:55.452763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa87d-7331-46cb-bac9-293ff3c7aca8 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:55.464000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa87d-7331-46cb-bac9-293ff3c7aca8 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:55.468994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed268-fee5-4ca3-9a14-cbc5c372af2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:55.469597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed268-fee5-4ca3-9a14-cbc5c372af2b admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.469877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed268-fee5-4ca3-9a14-cbc5c372af2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.470168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed268-fee5-4ca3-9a14-cbc5c372af2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.470843 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ed268-fee5-4ca3-9a14-cbc5c372af2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:55.472431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ed268-fee5-4ca3-9a14-cbc5c372af2b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:55.483262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1242/2504] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:55.487426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a20f31-87bc-47bc-ab94-55ece01e6e80 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:55.497512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a20f31-87bc-47bc-ab94-55ece01e6e80 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:55.502126 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84469709-db99-420b-9d99-038b94b771ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:55.502712 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84469709-db99-420b-9d99-038b94b771ae admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.503020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84469709-db99-420b-9d99-038b94b771ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.503292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84469709-db99-420b-9d99-038b94b771ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.503922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84469709-db99-420b-9d99-038b94b771ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:55.505543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84469709-db99-420b-9d99-038b94b771ae admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:55.516298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1263/2505] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:55.520452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed268-fee5-4ca3-9a14-cbc5c372af2b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:55.531115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed268-fee5-4ca3-9a14-cbc5c372af2b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:55.535772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a89d54-f989-4ba9-ab3b-a1ef5dc2b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:55.536421 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a89d54-f989-4ba9-ab3b-a1ef5dc2b8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.536699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a89d54-f989-4ba9-ab3b-a1ef5dc2b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.536973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a89d54-f989-4ba9-ab3b-a1ef5dc2b8ed admin admin] PATH_INFO: `/v3/projects/0f4b11c231f54fd8beb1e6c2e8b05a03/users/06fd5308ebe14990b5a146a91c9a380b/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.553436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a89d54-f989-4ba9-ab3b-a1ef5dc2b8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4b11c231f54fd8beb1e6c2e8b05a03, user_id=06fd5308ebe14990b5a146a91c9a380b, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:55.556333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a89d54-f989-4ba9-ab3b-a1ef5dc2b8ed admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:55.569920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1243/2506] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:55 2022] PUT /identity/v3/projects/0f4b11c231f54fd8beb1e6c2e8b05a03/users/06fd5308ebe14990b5a146a91c9a380b/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:55.575273 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57fa1-7c76-4dc9-a33b-7e63e56a407b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.575558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57fa1-7c76-4dc9-a33b-7e63e56a407b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.575829 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57fa1-7c76-4dc9-a33b-7e63e56a407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.594954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-28b57fa1-7c76-4dc9-a33b-7e63e56a407b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:55.596146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-28b57fa1-7c76-4dc9-a33b-7e63e56a407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:55.654567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1264/2507] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:55.664227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a89d54-f989-4ba9-ab3b-a1ef5dc2b8ed admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:55.667055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f6a89d54-f989-4ba9-ab3b-a1ef5dc2b8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:55.724798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a89d54-f989-4ba9-ab3b-a1ef5dc2b8ed admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:55.729499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a98f10-d449-47d5-bb84-88a3a00fa9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:55.730107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a98f10-d449-47d5-bb84-88a3a00fa9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:55.730390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a98f10-d449-47d5-bb84-88a3a00fa9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:55.730664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a98f10-d449-47d5-bb84-88a3a00fa9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:55.739777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a98f10-d449-47d5-bb84-88a3a00fa9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:55.741189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a98f10-d449-47d5-bb84-88a3a00fa9c9 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:55.751390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1244/2508] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:56.118793 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57fa1-7c76-4dc9-a33b-7e63e56a407b None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:56.120434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-28b57fa1-7c76-4dc9-a33b-7e63e56a407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:56.139060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57fa1-7c76-4dc9-a33b-7e63e56a407b None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:56.147331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:56.147925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:56.148207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:56.148488 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] PATH_INFO: `/v3/users/048048286a734cdc83805fe78cc821e7` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:56.150660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=048048286a734cdc83805fe78cc821e7)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:56.153214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:56.208510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a98f10-d449-47d5-bb84-88a3a00fa9c9 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:56.210353 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a3a98f10-d449-47d5-bb84-88a3a00fa9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:56.220013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048048286a734cdc83805fe78cc821e7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.220727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048048286a734cdc83805fe78cc821e7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.221345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048048286a734cdc83805fe78cc821e7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.225458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a98f10-d449-47d5-bb84-88a3a00fa9c9 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:56.229606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048048286a734cdc83805fe78cc821e7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.232237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:56.233110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:56.233525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:56.233811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] PATH_INFO: `/v3/users/8eb3d3089a544152a7e53bcb29c36d8d` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:56.235970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb3d3089a544152a7e53bcb29c36d8d)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:56.238062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:56.238228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-303a14ab-aabe-4d66-a623-dfbd48bbb1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048048286a734cdc83805fe78cc821e7'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.276113 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1265/2509] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:56 2022] DELETE /identity/v3/users/048048286a734cdc83805fe78cc821e7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:56.280948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402b53c-a67c-4c2c-a4dc-2df84cb510c4 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:56.281554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402b53c-a67c-4c2c-a4dc-2df84cb510c4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:56.282010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402b53c-a67c-4c2c-a4dc-2df84cb510c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:56.295684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb3d3089a544152a7e53bcb29c36d8d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.303960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb3d3089a544152a7e53bcb29c36d8d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.304769 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb3d3089a544152a7e53bcb29c36d8d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.307404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-1402b53c-a67c-4c2c-a4dc-2df84cb510c4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:56.309725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1402b53c-a67c-4c2c-a4dc-2df84cb510c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:56.313123 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:56.325492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb3d3089a544152a7e53bcb29c36d8d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.327305 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-1a030497-ba22-438f-b9c4-1c5eacad80fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb3d3089a544152a7e53bcb29c36d8d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:56.349706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1245/2510] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:56 2022] DELETE /identity/v3/users/8eb3d3089a544152a7e53bcb29c36d8d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:56.354794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5a4e-f9ae-4c55-a8db-a4fb9564ace9 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:56.355164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5a4e-f9ae-4c55-a8db-a4fb9564ace9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:56.355558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5a4e-f9ae-4c55-a8db-a4fb9564ace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:56.380419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c46b5a4e-f9ae-4c55-a8db-a4fb9564ace9 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:56.381736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c46b5a4e-f9ae-4c55-a8db-a4fb9564ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:56.384673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:56.400961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1266/2511] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:56.411053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402b53c-a67c-4c2c-a4dc-2df84cb510c4 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:56.412534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1402b53c-a67c-4c2c-a4dc-2df84cb510c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:56.463470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1246/2512] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:56.464814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9e024-2708-4b3a-a083-1118ee48905f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:56.465109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9e024-2708-4b3a-a083-1118ee48905f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:56.465483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9e024-2708-4b3a-a083-1118ee48905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:56.481982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402b53c-a67c-4c2c-a4dc-2df84cb510c4 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:56.496180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-75a9e024-2708-4b3a-a083-1118ee48905f None None] MFA Rules not processed for user `06fd5308ebe14990b5a146a91c9a380b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:56.497401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-75a9e024-2708-4b3a-a083-1118ee48905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:56.536146 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e426-e0ea-4320-863a-d5e224465794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:56.536802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e426-e0ea-4320-863a-d5e224465794 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:56.537174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e426-e0ea-4320-863a-d5e224465794 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:56.537593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e426-e0ea-4320-863a-d5e224465794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:56.548988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8e426-e0ea-4320-863a-d5e224465794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:56.550972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8e426-e0ea-4320-863a-d5e224465794 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:56.563186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1267/2513] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:56.564082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e426-e0ea-4320-863a-d5e224465794 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:56.574257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e426-e0ea-4320-863a-d5e224465794 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:56.580158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc60d-4144-4a63-a38e-9b6a06a41a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:56.580158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc60d-4144-4a63-a38e-9b6a06a41a7d service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:56.580158 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc60d-4144-4a63-a38e-9b6a06a41a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:56.580887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1247/2514] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:56.582982 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc60d-4144-4a63-a38e-9b6a06a41a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:56.589289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9e024-2708-4b3a-a083-1118ee48905f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:56.592889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-75a9e024-2708-4b3a-a083-1118ee48905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:56.601356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc60d-4144-4a63-a38e-9b6a06a41a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:56.605863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc60d-4144-4a63-a38e-9b6a06a41a7d service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:56.627261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1268/2515] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:56.678848 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9e024-2708-4b3a-a083-1118ee48905f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:56.683994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e670e-fea2-47d8-a76d-38a58b1c46ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:56.685167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e670e-fea2-47d8-a76d-38a58b1c46ab service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:56.690185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e670e-fea2-47d8-a76d-38a58b1c46ab service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:56.690514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e670e-fea2-47d8-a76d-38a58b1c46ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:56.706980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e670e-fea2-47d8-a76d-38a58b1c46ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:56.708737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e670e-fea2-47d8-a76d-38a58b1c46ab service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:56.722913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1248/2516] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:56.999286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc60d-4144-4a63-a38e-9b6a06a41a7d service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.001389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b59bc60d-4144-4a63-a38e-9b6a06a41a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.023428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc60d-4144-4a63-a38e-9b6a06a41a7d service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.042307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.043183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.043657 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.044057 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] PATH_INFO: `/v3/projects/0d90d6febfca496f9749bb41f010f027` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.045400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d90d6febfca496f9749bb41f010f027)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.048377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.057704 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e670e-fea2-47d8-a76d-38a58b1c46ab service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.059633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4c5e670e-fea2-47d8-a76d-38a58b1c46ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.094863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e670e-fea2-47d8-a76d-38a58b1c46ab service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.101957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.102833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.103117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.103389 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] PATH_INFO: `/v3/projects/e0bfaf52290946e483a4aa1d83867d0e` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.104699 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bfaf52290946e483a4aa1d83867d0e)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.107096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.119609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:57.138159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d90d6febfca496f9749bb41f010f027', 'request_id': 'req-18ef4a57-e940-44d9-b986-f11a0b68a5b6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.146231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d90d6febfca496f9749bb41f010f027', 'request_id': 'req-18ef4a57-e940-44d9-b986-f11a0b68a5b6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.155255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d90d6febfca496f9749bb41f010f027', 'request_id': 'req-18ef4a57-e940-44d9-b986-f11a0b68a5b6'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.171955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] The token cache is being invalidate because project 0d90d6febfca496f9749bb41f010f027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:57.172285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.172978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-18ef4a57-e940-44d9-b986-f11a0b68a5b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.175130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1269/2517] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:56 2022] DELETE /identity/v3/projects/0d90d6febfca496f9749bb41f010f027 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:57.179843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba67801-63ce-451d-86ba-c957b4d0e6f2 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.180131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba67801-63ce-451d-86ba-c957b4d0e6f2 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.180405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba67801-63ce-451d-86ba-c957b4d0e6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.185921 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bfaf52290946e483a4aa1d83867d0e', 'request_id': 'req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.195941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bfaf52290946e483a4aa1d83867d0e', 'request_id': 'req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.203012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bfaf52290946e483a4aa1d83867d0e', 'request_id': 'req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.204594 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-cba67801-63ce-451d-86ba-c957b4d0e6f2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:57.205972 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-cba67801-63ce-451d-86ba-c957b4d0e6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.215473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] The token cache is being invalidate because project e0bfaf52290946e483a4aa1d83867d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:57.216036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.216452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.217958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1249/2518] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:57 2022] DELETE /identity/v3/projects/e0bfaf52290946e483a4aa1d83867d0e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:57.221775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.223124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.230418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:57.282557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1270/2519] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:57.291775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0800640-7372-4781-902a-2f3f2dd1c14c None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.292066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0800640-7372-4781-902a-2f3f2dd1c14c None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.292169 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ae51-a9e9-4edb-8753-1c5d8ebee55e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.292388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0800640-7372-4781-902a-2f3f2dd1c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.296921 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.297567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.297878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.298174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] PATH_INFO: `/v3/users/8a4d8f2993c644b193d5de0752d257ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.299526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4d8f2993c644b193d5de0752d257ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.301538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.320457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b0800640-7372-4781-902a-2f3f2dd1c14c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:57.321864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b0800640-7372-4781-902a-2f3f2dd1c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.331076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1271/2520] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:57.336724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0800640-7372-4781-902a-2f3f2dd1c14c None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.347185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0800640-7372-4781-902a-2f3f2dd1c14c None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.352042 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4d8f2993c644b193d5de0752d257ea'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.352543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.354054 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.354575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.354892 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.355667 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:57.356144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.358093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.360685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4d8f2993c644b193d5de0752d257ea'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.361481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4d8f2993c644b193d5de0752d257ea'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.373792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1272/2521] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:51:57.376026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4d8f2993c644b193d5de0752d257ea'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.376837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4d8f2993c644b193d5de0752d257ea'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.379041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.380780 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.391240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1250/2522] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:57 2022] DELETE /identity/v3/users/8a4d8f2993c644b193d5de0752d257ea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:57.398799 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5c602-4759-4d63-ac13-863c1ada44f9 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.461553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5191a9e-c198-44b2-a840-9d9e7b004f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.462264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5191a9e-c198-44b2-a840-9d9e7b004f53 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.462873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5191a9e-c198-44b2-a840-9d9e7b004f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.463190 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5191a9e-c198-44b2-a840-9d9e7b004f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.463966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5191a9e-c198-44b2-a840-9d9e7b004f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.466298 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5191a9e-c198-44b2-a840-9d9e7b004f53 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.498164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1273/2523] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:57 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:57.502289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.512775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e651bf5-093e-443f-8c1a-506d30e6d33a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.525119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:57.579256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23048b9-5361-4c98-bf09-f1d4f2c1a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.579945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23048b9-5361-4c98-bf09-f1d4f2c1a7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.580293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23048b9-5361-4c98-bf09-f1d4f2c1a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.580638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23048b9-5361-4c98-bf09-f1d4f2c1a7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.581345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23048b9-5361-4c98-bf09-f1d4f2c1a7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.583346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23048b9-5361-4c98-bf09-f1d4f2c1a7d0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.612296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1251/2524] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:57 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:57.613596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5191a9e-c198-44b2-a840-9d9e7b004f53 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.625662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5191a9e-c198-44b2-a840-9d9e7b004f53 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.630426 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a74f1-6458-4dca-8aa1-96dc4286dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.631161 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a74f1-6458-4dca-8aa1-96dc4286dbed admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.631501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a74f1-6458-4dca-8aa1-96dc4286dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.631834 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a74f1-6458-4dca-8aa1-96dc4286dbed admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.632539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a74f1-6458-4dca-8aa1-96dc4286dbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.634334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a74f1-6458-4dca-8aa1-96dc4286dbed admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.650381 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1274/2525] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:57.652156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23048b9-5361-4c98-bf09-f1d4f2c1a7d0 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.662504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23048b9-5361-4c98-bf09-f1d4f2c1a7d0 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.668344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211c5a3-5c57-46fa-9e19-157e8a575e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.668951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211c5a3-5c57-46fa-9e19-157e8a575e10 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.669230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211c5a3-5c57-46fa-9e19-157e8a575e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.669507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211c5a3-5c57-46fa-9e19-157e8a575e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.670157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211c5a3-5c57-46fa-9e19-157e8a575e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.671840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211c5a3-5c57-46fa-9e19-157e8a575e10 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.682451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1252/2526] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:57.687364 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a74f1-6458-4dca-8aa1-96dc4286dbed admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.697143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211c5a3-5c57-46fa-9e19-157e8a575e10 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.699036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b211c5a3-5c57-46fa-9e19-157e8a575e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.701165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a74f1-6458-4dca-8aa1-96dc4286dbed admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.706403 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa0d25-3f0d-4541-9953-33fc18fbfb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.707173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0d25-3f0d-4541-9953-33fc18fbfb29 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.707384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0d25-3f0d-4541-9953-33fc18fbfb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.707639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0d25-3f0d-4541-9953-33fc18fbfb29 admin admin] PATH_INFO: `/v3/projects/def2691838f349178d94a4c244437e22/users/d4c6724c4baa4de3827ac37114f6396b/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.719768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211c5a3-5c57-46fa-9e19-157e8a575e10 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.724770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa0d25-3f0d-4541-9953-33fc18fbfb29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def2691838f349178d94a4c244437e22, user_id=d4c6724c4baa4de3827ac37114f6396b, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.726933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.727660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa0d25-3f0d-4541-9953-33fc18fbfb29 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.728452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.729247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.729247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] PATH_INFO: `/v3/projects/4a439f9ebb25487882ba2e843ca5de43` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.730266 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a439f9ebb25487882ba2e843ca5de43)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.732782 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.742232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1275/2527] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:57 2022] PUT /identity/v3/projects/def2691838f349178d94a4c244437e22/users/d4c6724c4baa4de3827ac37114f6396b/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:57.753970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b27c69-3ddc-433c-8477-6435c07a59fb None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.754188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b27c69-3ddc-433c-8477-6435c07a59fb None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.754425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b27c69-3ddc-433c-8477-6435c07a59fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.785800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-28b27c69-3ddc-433c-8477-6435c07a59fb None None] MFA Rules not processed for user `d4c6724c4baa4de3827ac37114f6396b`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:57.787137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-28b27c69-3ddc-433c-8477-6435c07a59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.795550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a439f9ebb25487882ba2e843ca5de43', 'request_id': 'req-56e2113c-a426-4ea4-8365-59a0464750ba'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.803418 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a439f9ebb25487882ba2e843ca5de43', 'request_id': 'req-56e2113c-a426-4ea4-8365-59a0464750ba'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.810112 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a439f9ebb25487882ba2e843ca5de43', 'request_id': 'req-56e2113c-a426-4ea4-8365-59a0464750ba'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.823795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] The token cache is being invalidate because project 4a439f9ebb25487882ba2e843ca5de43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:57.824122 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.824797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.826606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1253/2528] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:57 2022] DELETE /identity/v3/projects/4a439f9ebb25487882ba2e843ca5de43 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:51:57.831199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.832633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.841997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:57.868366 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1276/2529] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:57.879821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b27c69-3ddc-433c-8477-6435c07a59fb None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:57.881201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-28b27c69-3ddc-433c-8477-6435c07a59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:57.906197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2113c-a426-4ea4-8365-59a0464750ba admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.910967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.911588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.911865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.912138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] PATH_INFO: `/v3/users/a6a9b564fef34ae1bf115be5d818ee1d` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.913265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a9b564fef34ae1bf115be5d818ee1d)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.915279 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.939268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:57.962491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b27c69-3ddc-433c-8477-6435c07a59fb None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:57.968348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07f463-e674-449b-a4cc-902e2dd80342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:57.968970 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07f463-e674-449b-a4cc-902e2dd80342 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:57.969248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07f463-e674-449b-a4cc-902e2dd80342 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:57.969520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07f463-e674-449b-a4cc-902e2dd80342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:57.975738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a9b564fef34ae1bf115be5d818ee1d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.980928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07f463-e674-449b-a4cc-902e2dd80342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:57.982569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07f463-e674-449b-a4cc-902e2dd80342 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:57.983846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a9b564fef34ae1bf115be5d818ee1d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.984573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a9b564fef34ae1bf115be5d818ee1d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.992041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1277/2530] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:51:57.997476 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a9b564fef34ae1bf115be5d818ee1d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:57.998436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a916a356-ce14-47dc-a3fe-5b20289f5a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a9b564fef34ae1bf115be5d818ee1d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.020431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1254/2531] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:57 2022] DELETE /identity/v3/users/a6a9b564fef34ae1bf115be5d818ee1d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:58.235264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07f463-e674-449b-a4cc-902e2dd80342 service nova] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:58.236681 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0d07f463-e674-449b-a4cc-902e2dd80342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:58.263282 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07f463-e674-449b-a4cc-902e2dd80342 service nova] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:58.270942 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b3ed5-0a93-4513-a936-e49adbfc5be5 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.271453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b3ed5-0a93-4513-a936-e49adbfc5be5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.271576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b3ed5-0a93-4513-a936-e49adbfc5be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.295273 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5c4b3ed5-0a93-4513-a936-e49adbfc5be5 None None] MFA Rules not processed for user `06fd5308ebe14990b5a146a91c9a380b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:58.297219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5c4b3ed5-0a93-4513-a936-e49adbfc5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:58.346553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:58.347439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.347723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.348076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] PATH_INFO: `/v3/users/d4c6724c4baa4de3827ac37114f6396b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.349136 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c6724c4baa4de3827ac37114f6396b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:58.351110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:58.372148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1255/2532] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:58.373167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b3ed5-0a93-4513-a936-e49adbfc5be5 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:58.374894 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5c4b3ed5-0a93-4513-a936-e49adbfc5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:58.393730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b3ed5-0a93-4513-a936-e49adbfc5be5 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:58.403828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:58.404600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.404976 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.405343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] PATH_INFO: `/v3/projects/34182560fb2a4e5c8f188ec2091908ee` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.406891 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34182560fb2a4e5c8f188ec2091908ee)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:58.407252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c6724c4baa4de3827ac37114f6396b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.408451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c6724c4baa4de3827ac37114f6396b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.408581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c6724c4baa4de3827ac37114f6396b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.409329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:58.416723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c6724c4baa4de3827ac37114f6396b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.426997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-0cc11ab5-50b4-4bc7-ad5a-337e60b23f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c6724c4baa4de3827ac37114f6396b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.435703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:58.452589 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1278/2533] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:51:58 2022] DELETE /identity/v3/users/d4c6724c4baa4de3827ac37114f6396b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:58.457737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf36ab-96ef-4b52-bcd6-197adf1b64ce None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.458289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf36ab-96ef-4b52-bcd6-197adf1b64ce None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.458857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf36ab-96ef-4b52-bcd6-197adf1b64ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.475931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34182560fb2a4e5c8f188ec2091908ee', 'request_id': 'req-aacf83d7-0d9a-40bd-9dac-d440668da9d8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.485893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-dfbf36ab-96ef-4b52-bcd6-197adf1b64ce None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:58.487236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dfbf36ab-96ef-4b52-bcd6-197adf1b64ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:58.487724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34182560fb2a4e5c8f188ec2091908ee', 'request_id': 'req-aacf83d7-0d9a-40bd-9dac-d440668da9d8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.496343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34182560fb2a4e5c8f188ec2091908ee', 'request_id': 'req-aacf83d7-0d9a-40bd-9dac-d440668da9d8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.513124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] The token cache is being invalidate because project 34182560fb2a4e5c8f188ec2091908ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:58.513124 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.513370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-aacf83d7-0d9a-40bd-9dac-d440668da9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:58.518357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1256/2534] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:58 2022] DELETE /identity/v3/projects/34182560fb2a4e5c8f188ec2091908ee => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:58.519859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8636bc-79a1-4563-b3bf-fb41ebbf3a38 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.520147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8636bc-79a1-4563-b3bf-fb41ebbf3a38 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.520427 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8636bc-79a1-4563-b3bf-fb41ebbf3a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.543587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ed8636bc-79a1-4563-b3bf-fb41ebbf3a38 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:58.544267 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ed8636bc-79a1-4563-b3bf-fb41ebbf3a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:58.563479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1279/2535] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:58.575696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf36ab-96ef-4b52-bcd6-197adf1b64ce None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:58.576068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:58.577745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dfbf36ab-96ef-4b52-bcd6-197adf1b64ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:58.626265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1257/2536] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:58.635374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1ddb9-1816-413a-bbe6-a07359812fc5 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.635731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1ddb9-1816-413a-bbe6-a07359812fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.636010 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1ddb9-1816-413a-bbe6-a07359812fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.648082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf36ab-96ef-4b52-bcd6-197adf1b64ce None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:58.653103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b85adb-f658-406d-a7ab-343ac6b2840d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:58.653987 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b85adb-f658-406d-a7ab-343ac6b2840d service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.654269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b85adb-f658-406d-a7ab-343ac6b2840d service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.654548 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b85adb-f658-406d-a7ab-343ac6b2840d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.656739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-56e1ddb9-1816-413a-bbe6-a07359812fc5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:58.657945 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-56e1ddb9-1816-413a-bbe6-a07359812fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:58.664931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b85adb-f658-406d-a7ab-343ac6b2840d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:58.666996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b85adb-f658-406d-a7ab-343ac6b2840d service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:58.667658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1258/2537] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:58.671534 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1ddb9-1816-413a-bbe6-a07359812fc5 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:58.672830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-56e1ddb9-1816-413a-bbe6-a07359812fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:58.677118 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1280/2538] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:51:58.677922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b85adb-f658-406d-a7ab-343ac6b2840d service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:58.684931 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1ddb9-1816-413a-bbe6-a07359812fc5 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:58.688740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d0f4-b0a4-4c04-b420-0684201a71b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:58.689348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d0f4-b0a4-4c04-b420-0684201a71b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.689623 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d0f4-b0a4-4c04-b420-0684201a71b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.689888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d0f4-b0a4-4c04-b420-0684201a71b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.690664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b85adb-f658-406d-a7ab-343ac6b2840d service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:58.691914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5281d0f4-b0a4-4c04-b420-0684201a71b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:58.695836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf4fad-ab21-46d4-8a20-309bb1d451dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:58.696842 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf4fad-ab21-46d4-8a20-309bb1d451dd admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.697368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf4fad-ab21-46d4-8a20-309bb1d451dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.697689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf4fad-ab21-46d4-8a20-309bb1d451dd admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.698448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf4fad-ab21-46d4-8a20-309bb1d451dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:58.699335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf4fad-ab21-46d4-8a20-309bb1d451dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:58.702011 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf4fad-ab21-46d4-8a20-309bb1d451dd admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:58.703138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281d0f4-b0a4-4c04-b420-0684201a71b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:58.706104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281d0f4-b0a4-4c04-b420-0684201a71b0 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:58.718876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1259/2539] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:58.719189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1281/2540] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:51:58.723384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d0f4-b0a4-4c04-b420-0684201a71b0 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:58.736091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d0f4-b0a4-4c04-b420-0684201a71b0 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:58.741473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66a90-eca0-467c-b16b-a0303c79c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:58.741951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66a90-eca0-467c-b16b-a0303c79c318 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.742325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66a90-eca0-467c-b16b-a0303c79c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.743380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66a90-eca0-467c-b16b-a0303c79c318 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.744047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e66a90-eca0-467c-b16b-a0303c79c318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:58.745957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e66a90-eca0-467c-b16b-a0303c79c318 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:58.782972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1260/2541] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:58 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:58.787309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf4fad-ab21-46d4-8a20-309bb1d451dd admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:58.800683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf4fad-ab21-46d4-8a20-309bb1d451dd admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:58.911612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d6b2-cfde-41d5-ac6c-5a3669112f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:58.912281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d6b2-cfde-41d5-ac6c-5a3669112f0c admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.912552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d6b2-cfde-41d5-ac6c-5a3669112f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.912858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d6b2-cfde-41d5-ac6c-5a3669112f0c admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.914496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d6b2-cfde-41d5-ac6c-5a3669112f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:58.916980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d6b2-cfde-41d5-ac6c-5a3669112f0c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:58.943884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1282/2542] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:58 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:58.949607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66a90-eca0-467c-b16b-a0303c79c318 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:58.959878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66a90-eca0-467c-b16b-a0303c79c318 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:58.965261 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603eb40-fbdd-4f57-a67b-54ff4f7b38dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:58.965868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603eb40-fbdd-4f57-a67b-54ff4f7b38dc admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:58.966146 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603eb40-fbdd-4f57-a67b-54ff4f7b38dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:58.966422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603eb40-fbdd-4f57-a67b-54ff4f7b38dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:58.967143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603eb40-fbdd-4f57-a67b-54ff4f7b38dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:58.968743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603eb40-fbdd-4f57-a67b-54ff4f7b38dc admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:58.981524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1261/2543] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:58.985392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d6b2-cfde-41d5-ac6c-5a3669112f0c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:58.996203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d6b2-cfde-41d5-ac6c-5a3669112f0c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.001414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc797b4-97ca-46e7-9fdd-33ca502b1f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.002155 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc797b4-97ca-46e7-9fdd-33ca502b1f0a admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.002287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc797b4-97ca-46e7-9fdd-33ca502b1f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.002689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc797b4-97ca-46e7-9fdd-33ca502b1f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.003377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc797b4-97ca-46e7-9fdd-33ca502b1f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.004977 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc797b4-97ca-46e7-9fdd-33ca502b1f0a admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.007507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:59.022902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1283/2544] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:59.027374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603eb40-fbdd-4f57-a67b-54ff4f7b38dc admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:59.039125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603eb40-fbdd-4f57-a67b-54ff4f7b38dc admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.045978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44d52-d06f-4c55-b480-c7a343e1d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.046656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44d52-d06f-4c55-b480-c7a343e1d706 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.047999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44d52-d06f-4c55-b480-c7a343e1d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.047999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44d52-d06f-4c55-b480-c7a343e1d706 admin admin] PATH_INFO: `/v3/projects/938853dc42a74e78880d667b1b3851fc/users/d6f682aad5bb4943a72f5c3fe2391816/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.087518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44d52-d06f-4c55-b480-c7a343e1d706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938853dc42a74e78880d667b1b3851fc, user_id=d6f682aad5bb4943a72f5c3fe2391816, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.090950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44d52-d06f-4c55-b480-c7a343e1d706 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.098233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc797b4-97ca-46e7-9fdd-33ca502b1f0a admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:59.101121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-bfc797b4-97ca-46e7-9fdd-33ca502b1f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:59.123148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc797b4-97ca-46e7-9fdd-33ca502b1f0a admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.135345 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1262/2545] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:59 2022] PUT /identity/v3/projects/938853dc42a74e78880d667b1b3851fc/users/d6f682aad5bb4943a72f5c3fe2391816/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:59.156013 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4fd82-29f1-4bf8-8c90-e2b4b5d94e3f None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.156342 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4fd82-29f1-4bf8-8c90-e2b4b5d94e3f None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.156625 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4fd82-29f1-4bf8-8c90-e2b4b5d94e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.216929 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-cca4fd82-29f1-4bf8-8c90-e2b4b5d94e3f None None] MFA Rules not processed for user `d6f682aad5bb4943a72f5c3fe2391816`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:59.218989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cca4fd82-29f1-4bf8-8c90-e2b4b5d94e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:59.229909 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.230472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.230756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.231204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] PATH_INFO: `/v3/projects/def2691838f349178d94a4c244437e22` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.232207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=def2691838f349178d94a4c244437e22)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.234123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.298252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def2691838f349178d94a4c244437e22', 'request_id': 'req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:59.305573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def2691838f349178d94a4c244437e22', 'request_id': 'req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:59.312320 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1263/2546] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:59.315895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def2691838f349178d94a4c244437e22', 'request_id': 'req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:59.326720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4fd82-29f1-4bf8-8c90-e2b4b5d94e3f None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:59.328716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cca4fd82-29f1-4bf8-8c90-e2b4b5d94e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:59.331373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] The token cache is being invalidate because project def2691838f349178d94a4c244437e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:51:59.331675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:59.332417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-a2c04f81-4413-424b-b3fc-cbe880cbd1dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:51:59.334002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1284/2547] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:51:59 2022] DELETE /identity/v3/projects/def2691838f349178d94a4c244437e22 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:59.339485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf6de2-276a-4fd2-b5fb-4a86383f49b3 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.339900 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf6de2-276a-4fd2-b5fb-4a86383f49b3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.340365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf6de2-276a-4fd2-b5fb-4a86383f49b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.360706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-95cf6de2-276a-4fd2-b5fb-4a86383f49b3 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:59.361948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-95cf6de2-276a-4fd2-b5fb-4a86383f49b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:59.378023 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:59.397986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4fd82-29f1-4bf8-8c90-e2b4b5d94e3f None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.437789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1285/2548] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:51:59.445994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401eaa-1831-41e3-93cd-1a95f20fd6ca None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.447318 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401eaa-1831-41e3-93cd-1a95f20fd6ca None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.447644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d401eaa-1831-41e3-93cd-1a95f20fd6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.464612 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ac76e-83c5-41b2-9491-c2ce27ee5d83 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3bd33cac7d4715bede59def04cdb92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.465414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac76e-83c5-41b2-9491-c2ce27ee5d83 service glance] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.465539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac76e-83c5-41b2-9491-c2ce27ee5d83 service glance] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.465787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac76e-83c5-41b2-9491-c2ce27ee5d83 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.468372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d19ac76e-83c5-41b2-9491-c2ce27ee5d83 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:59.473239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-8d401eaa-1831-41e3-93cd-1a95f20fd6ca None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:59.474917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8d401eaa-1831-41e3-93cd-1a95f20fd6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:59.486217 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1286/2549] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:51:59.490573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401eaa-1831-41e3-93cd-1a95f20fd6ca None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:59.500163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d401eaa-1831-41e3-93cd-1a95f20fd6ca None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.506501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55dc97-eb66-4d9e-bba9-1cdeacc27fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.507804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55dc97-eb66-4d9e-bba9-1cdeacc27fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.508293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55dc97-eb66-4d9e-bba9-1cdeacc27fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.509223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55dc97-eb66-4d9e-bba9-1cdeacc27fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.510121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55dc97-eb66-4d9e-bba9-1cdeacc27fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:51:59.510668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55dc97-eb66-4d9e-bba9-1cdeacc27fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.512816 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55dc97-eb66-4d9e-bba9-1cdeacc27fe0 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.527380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1287/2550] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:51:59.531920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55dc97-eb66-4d9e-bba9-1cdeacc27fe0 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:59.541451 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ac76e-83c5-41b2-9491-c2ce27ee5d83 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.542923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ac76e-83c5-41b2-9491-c2ce27ee5d83 service glance] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.543278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55dc97-eb66-4d9e-bba9-1cdeacc27fe0 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.548490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093b2f9-9b01-48dc-b0c2-a82f302ae4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.549018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b2f9-9b01-48dc-b0c2-a82f302ae4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.549303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b2f9-9b01-48dc-b0c2-a82f302ae4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.549592 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093b2f9-9b01-48dc-b0c2-a82f302ae4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.550543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093b2f9-9b01-48dc-b0c2-a82f302ae4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.552500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093b2f9-9b01-48dc-b0c2-a82f302ae4c3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.553466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1264/2551] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:51:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:51:59.558854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:51:59.595955 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1288/2552] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:51:59 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:59.600072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ac76e-83c5-41b2-9491-c2ce27ee5d83 service glance] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:59.615800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ac76e-83c5-41b2-9491-c2ce27ee5d83 service glance] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.692355 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aef3e2-dc96-4fd9-a9ec-07ad2f96f0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.693024 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aef3e2-dc96-4fd9-a9ec-07ad2f96f0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.693416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aef3e2-dc96-4fd9-a9ec-07ad2f96f0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.693735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aef3e2-dc96-4fd9-a9ec-07ad2f96f0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.694452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aef3e2-dc96-4fd9-a9ec-07ad2f96f0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.697496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aef3e2-dc96-4fd9-a9ec-07ad2f96f0a8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.724090 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1265/2553] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:51:59 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:51:59.729376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093b2f9-9b01-48dc-b0c2-a82f302ae4c3 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:59.740251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093b2f9-9b01-48dc-b0c2-a82f302ae4c3 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.745826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555af593-e789-435a-b7c8-ef887d543b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.746429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555af593-e789-435a-b7c8-ef887d543b70 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.746712 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555af593-e789-435a-b7c8-ef887d543b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.747020 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555af593-e789-435a-b7c8-ef887d543b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.747669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555af593-e789-435a-b7c8-ef887d543b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.749269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555af593-e789-435a-b7c8-ef887d543b70 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.761307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1289/2554] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:59.765915 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aef3e2-dc96-4fd9-a9ec-07ad2f96f0a8 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:59.779121 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aef3e2-dc96-4fd9-a9ec-07ad2f96f0a8 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.783986 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9588-b21f-4ae8-a74f-33ddf88b0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.784703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9588-b21f-4ae8-a74f-33ddf88b0b7a admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.785104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9588-b21f-4ae8-a74f-33ddf88b0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.785497 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9588-b21f-4ae8-a74f-33ddf88b0b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.786249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef9588-b21f-4ae8-a74f-33ddf88b0b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.787982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef9588-b21f-4ae8-a74f-33ddf88b0b7a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.804463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1266/2555] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:51:59.808227 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555af593-e789-435a-b7c8-ef887d543b70 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:51:59.821051 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555af593-e789-435a-b7c8-ef887d543b70 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:51:59.826957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21243f-a0cf-4444-9067-8386135250af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:51:59.827664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21243f-a0cf-4444-9067-8386135250af admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.827948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21243f-a0cf-4444-9067-8386135250af admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.828237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21243f-a0cf-4444-9067-8386135250af admin admin] PATH_INFO: `/v3/projects/c24af04ec5c04782b2882953f5d0a0c6/users/92df50200f3b49fbb6dc40aa3750cb04/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.847868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21243f-a0cf-4444-9067-8386135250af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24af04ec5c04782b2882953f5d0a0c6, user_id=92df50200f3b49fbb6dc40aa3750cb04, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:51:59.851023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21243f-a0cf-4444-9067-8386135250af admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:51:59.874988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1290/2556] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:51:59 2022] PUT /identity/v3/projects/c24af04ec5c04782b2882953f5d0a0c6/users/92df50200f3b49fbb6dc40aa3750cb04/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:51:59.886907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e8692-5a89-4a4f-899c-35178ff4b6e9 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:51:59.887197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e8692-5a89-4a4f-899c-35178ff4b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:51:59.887677 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e8692-5a89-4a4f-899c-35178ff4b6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:51:59.927277 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-432e8692-5a89-4a4f-899c-35178ff4b6e9 None None] MFA Rules not processed for user `92df50200f3b49fbb6dc40aa3750cb04`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:51:59.928988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-432e8692-5a89-4a4f-899c-35178ff4b6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:51:59.954429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:00.019336 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1267/2557] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:51:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:00.024960 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21243f-a0cf-4444-9067-8386135250af admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:00.108440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21243f-a0cf-4444-9067-8386135250af admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:00.113275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f82ff1-4856-4ee9-b507-6f56e371856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:00.114026 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f82ff1-4856-4ee9-b507-6f56e371856c admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:00.114309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f82ff1-4856-4ee9-b507-6f56e371856c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:00.114608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f82ff1-4856-4ee9-b507-6f56e371856c admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:00.115264 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f82ff1-4856-4ee9-b507-6f56e371856c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:00.117174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f82ff1-4856-4ee9-b507-6f56e371856c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:00.147664 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1291/2558] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:00 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:00.152612 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e8692-5a89-4a4f-899c-35178ff4b6e9 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:00.163520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e8692-5a89-4a4f-899c-35178ff4b6e9 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:00.229953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f1276-46b8-434b-8d08-2d058d86820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:00.230982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f1276-46b8-434b-8d08-2d058d86820c admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:00.231510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f1276-46b8-434b-8d08-2d058d86820c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:00.232951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f1276-46b8-434b-8d08-2d058d86820c admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:00.234663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f1276-46b8-434b-8d08-2d058d86820c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:00.237479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f1276-46b8-434b-8d08-2d058d86820c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:00.278890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1268/2559] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:00 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:00.279772 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f82ff1-4856-4ee9-b507-6f56e371856c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:00.320686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f82ff1-4856-4ee9-b507-6f56e371856c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:00.329537 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54609a-1684-4ca6-936e-68da89c39720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:00.330182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54609a-1684-4ca6-936e-68da89c39720 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:00.330463 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54609a-1684-4ca6-936e-68da89c39720 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:00.330746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54609a-1684-4ca6-936e-68da89c39720 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:00.331448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54609a-1684-4ca6-936e-68da89c39720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:00.333261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54609a-1684-4ca6-936e-68da89c39720 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:00.348872 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1292/2560] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:00.353726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f1276-46b8-434b-8d08-2d058d86820c admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:00.373805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f1276-46b8-434b-8d08-2d058d86820c admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:00.382107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64cae-9f92-43dc-ab81-256dbab95713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:00.383043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64cae-9f92-43dc-ab81-256dbab95713 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:00.383383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64cae-9f92-43dc-ab81-256dbab95713 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:00.383800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64cae-9f92-43dc-ab81-256dbab95713 admin admin] PATH_INFO: `/v3/projects/3d3e149c613d425dacb39338c9013f79/users/558dfcc2e996414eae00ede0e4e6f7b7/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:00.423826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e64cae-9f92-43dc-ab81-256dbab95713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3e149c613d425dacb39338c9013f79, user_id=558dfcc2e996414eae00ede0e4e6f7b7, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:00.426977 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e64cae-9f92-43dc-ab81-256dbab95713 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:00.463607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1269/2561] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:00 2022] PUT /identity/v3/projects/3d3e149c613d425dacb39338c9013f79/users/558dfcc2e996414eae00ede0e4e6f7b7/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:00.464251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54609a-1684-4ca6-936e-68da89c39720 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:00.483220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54609a-1684-4ca6-936e-68da89c39720 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:00.591809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f6777-561a-49e0-9601-70af7490035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:00.592567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f6777-561a-49e0-9601-70af7490035f admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:00.592925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f6777-561a-49e0-9601-70af7490035f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:00.593279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f6777-561a-49e0-9601-70af7490035f admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:00.594010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f6777-561a-49e0-9601-70af7490035f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:00.595792 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f6777-561a-49e0-9601-70af7490035f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:00.608547 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1293/2562] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:00.613055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64cae-9f92-43dc-ab81-256dbab95713 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:00.628375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64cae-9f92-43dc-ab81-256dbab95713 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:00.634997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6e4d3-26a4-46d3-9e66-46416aae4a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:00.635988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6e4d3-26a4-46d3-9e66-46416aae4a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:00.636414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6e4d3-26a4-46d3-9e66-46416aae4a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:00.636824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6e4d3-26a4-46d3-9e66-46416aae4a4e admin admin] PATH_INFO: `/v3/projects/3d3e149c613d425dacb39338c9013f79/users/558dfcc2e996414eae00ede0e4e6f7b7/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:00.639640 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6e4d3-26a4-46d3-9e66-46416aae4a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3e149c613d425dacb39338c9013f79, user_id=558dfcc2e996414eae00ede0e4e6f7b7, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:00.642975 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6e4d3-26a4-46d3-9e66-46416aae4a4e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:00.663334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1270/2563] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:00 2022] PUT /identity/v3/projects/3d3e149c613d425dacb39338c9013f79/users/558dfcc2e996414eae00ede0e4e6f7b7/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:00.676112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc69b0-eef5-441e-8572-57e7800960e3 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:00.676424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc69b0-eef5-441e-8572-57e7800960e3 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:00.676706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc69b0-eef5-441e-8572-57e7800960e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:00.714832 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-1bcc69b0-eef5-441e-8572-57e7800960e3 None None] MFA Rules not processed for user `558dfcc2e996414eae00ede0e4e6f7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:00.715655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1bcc69b0-eef5-441e-8572-57e7800960e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:00.743412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:00.818890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1294/2564] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:00.839282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6e4d3-26a4-46d3-9e66-46416aae4a4e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:00.842828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-02d6e4d3-26a4-46d3-9e66-46416aae4a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:00.924433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6e4d3-26a4-46d3-9e66-46416aae4a4e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:00.931078 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014c06f-435f-4fa3-8cf3-37b70d3404af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:00.931078 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014c06f-435f-4fa3-8cf3-37b70d3404af service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:00.931078 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014c06f-435f-4fa3-8cf3-37b70d3404af service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:00.931078 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014c06f-435f-4fa3-8cf3-37b70d3404af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:00.945202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014c06f-435f-4fa3-8cf3-37b70d3404af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:00.946498 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014c06f-435f-4fa3-8cf3-37b70d3404af service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:00.964521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1271/2565] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:01.079013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc69b0-eef5-441e-8572-57e7800960e3 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:01.091184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc69b0-eef5-441e-8572-57e7800960e3 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:01.096609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712395b7-f8d3-469f-b03c-a2fd84cde675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:01.098016 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712395b7-f8d3-469f-b03c-a2fd84cde675 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:01.099178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712395b7-f8d3-469f-b03c-a2fd84cde675 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:01.099178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712395b7-f8d3-469f-b03c-a2fd84cde675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:01.199595 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712395b7-f8d3-469f-b03c-a2fd84cde675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:01.201148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712395b7-f8d3-469f-b03c-a2fd84cde675 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:01.211130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1295/2566] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:02.089606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014c06f-435f-4fa3-8cf3-37b70d3404af service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:02.091130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3014c06f-435f-4fa3-8cf3-37b70d3404af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:02.116868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:02.185361 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014c06f-435f-4fa3-8cf3-37b70d3404af service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:02.191428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3632-a6e7-4cae-ad10-73551c22768d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:02.192043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3632-a6e7-4cae-ad10-73551c22768d service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:02.192318 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3632-a6e7-4cae-ad10-73551c22768d service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:02.192584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3632-a6e7-4cae-ad10-73551c22768d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:02.194358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d5bd3632-a6e7-4cae-ad10-73551c22768d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:02.207390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd3632-a6e7-4cae-ad10-73551c22768d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:02.208974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd3632-a6e7-4cae-ad10-73551c22768d service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:02.222812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1272/2567] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:05.768629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712395b7-f8d3-469f-b03c-a2fd84cde675 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:05.783410 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712395b7-f8d3-469f-b03c-a2fd84cde675 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:05.789757 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27843015-8fe9-4c2d-a552-6c543354770b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:05.791035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27843015-8fe9-4c2d-a552-6c543354770b service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:05.791499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27843015-8fe9-4c2d-a552-6c543354770b service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:05.791939 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27843015-8fe9-4c2d-a552-6c543354770b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:05.797875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-27843015-8fe9-4c2d-a552-6c543354770b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:05.814040 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27843015-8fe9-4c2d-a552-6c543354770b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:05.815810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27843015-8fe9-4c2d-a552-6c543354770b service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:05.829637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1296/2568] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:08.194263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3632-a6e7-4cae-ad10-73551c22768d service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:08.256745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3632-a6e7-4cae-ad10-73551c22768d service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:08.261716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:08.262344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:08.262623 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:08.262938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] PATH_INFO: `/v3/users/92df50200f3b49fbb6dc40aa3750cb04` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:08.264068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92df50200f3b49fbb6dc40aa3750cb04)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:08.266236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:08.316936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92df50200f3b49fbb6dc40aa3750cb04'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:08.324138 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92df50200f3b49fbb6dc40aa3750cb04'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:08.324814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92df50200f3b49fbb6dc40aa3750cb04'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:08.337227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92df50200f3b49fbb6dc40aa3750cb04'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:08.337938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92df50200f3b49fbb6dc40aa3750cb04'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:08.351601 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1273/2569] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:08 2022] DELETE /identity/v3/users/92df50200f3b49fbb6dc40aa3750cb04 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:08.357208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ff9c6-53ba-4899-ac2a-3095d58cfcfa None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:08.357726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ff9c6-53ba-4899-ac2a-3095d58cfcfa None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:08.357726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ff9c6-53ba-4899-ac2a-3095d58cfcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:08.377311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9d4ff9c6-53ba-4899-ac2a-3095d58cfcfa None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:08.378524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9d4ff9c6-53ba-4899-ac2a-3095d58cfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:08.458559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1297/2570] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:08.468706 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:08.470120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:08.488903 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:08.530031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400b2b6-b514-45a7-91b5-01302f93f032 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:08.533639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9213d7c-e711-4457-9742-041c0a94c7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:08.534242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9213d7c-e711-4457-9742-041c0a94c7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:08.534519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9213d7c-e711-4457-9742-041c0a94c7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:08.534811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9213d7c-e711-4457-9742-041c0a94c7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:08.544419 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9213d7c-e711-4457-9742-041c0a94c7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:08.545886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9213d7c-e711-4457-9742-041c0a94c7f4 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:08.556278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1274/2571] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:08.933139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ff9c6-53ba-4899-ac2a-3095d58cfcfa None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:08.934797 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9d4ff9c6-53ba-4899-ac2a-3095d58cfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:08.949943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ff9c6-53ba-4899-ac2a-3095d58cfcfa None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:08.955928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:08.956597 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:08.956904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:08.957177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] PATH_INFO: `/v3/projects/c24af04ec5c04782b2882953f5d0a0c6` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:08.958353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24af04ec5c04782b2882953f5d0a0c6)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:08.960864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:08.998304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:09.016312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24af04ec5c04782b2882953f5d0a0c6', 'request_id': 'req-e1273018-44fc-4de1-b8b9-b2dad7812e44'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.023642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24af04ec5c04782b2882953f5d0a0c6', 'request_id': 'req-e1273018-44fc-4de1-b8b9-b2dad7812e44'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.030376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24af04ec5c04782b2882953f5d0a0c6', 'request_id': 'req-e1273018-44fc-4de1-b8b9-b2dad7812e44'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.044116 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] The token cache is being invalidate because project c24af04ec5c04782b2882953f5d0a0c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:09.044407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.045192 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.047996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1298/2572] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:08 2022] DELETE /identity/v3/projects/c24af04ec5c04782b2882953f5d0a0c6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:09.053025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9213d7c-e711-4457-9742-041c0a94c7f4 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:09.075017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9213d7c-e711-4457-9742-041c0a94c7f4 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:09.140799 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:09.141436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:09.141714 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:09.141984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] PATH_INFO: `/v3/users/558dfcc2e996414eae00ede0e4e6f7b7` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:09.143214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=558dfcc2e996414eae00ede0e4e6f7b7)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:09.145863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:09.198862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558dfcc2e996414eae00ede0e4e6f7b7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.206251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558dfcc2e996414eae00ede0e4e6f7b7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.207064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558dfcc2e996414eae00ede0e4e6f7b7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.219933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558dfcc2e996414eae00ede0e4e6f7b7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.220849 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-495971b9-d7cf-4150-891b-07c6188b8b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558dfcc2e996414eae00ede0e4e6f7b7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:09.242826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1275/2573] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:09 2022] DELETE /identity/v3/users/558dfcc2e996414eae00ede0e4e6f7b7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:09.889607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:09.891522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:09.908137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273018-44fc-4de1-b8b9-b2dad7812e44 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:09.969686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:09.970329 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:09.970607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:09.970919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] PATH_INFO: `/v3/projects/3d3e149c613d425dacb39338c9013f79` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:09.972127 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3e149c613d425dacb39338c9013f79)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:09.974121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:10.023149 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3e149c613d425dacb39338c9013f79', 'request_id': 'req-2c8d4c38-d155-4227-b600-f5892a6c1c10'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.029638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3e149c613d425dacb39338c9013f79', 'request_id': 'req-2c8d4c38-d155-4227-b600-f5892a6c1c10'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.035178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3e149c613d425dacb39338c9013f79', 'request_id': 'req-2c8d4c38-d155-4227-b600-f5892a6c1c10'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.048509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] The token cache is being invalidate because project 3d3e149c613d425dacb39338c9013f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:10.048798 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.049411 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-2c8d4c38-d155-4227-b600-f5892a6c1c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.050918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1299/2574] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:09 2022] DELETE /identity/v3/projects/3d3e149c613d425dacb39338c9013f79 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:10.056063 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b3fd-9f57-4d33-b043-d21483d81c0d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.056469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b3fd-9f57-4d33-b043-d21483d81c0d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.056778 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b3fd-9f57-4d33-b043-d21483d81c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.076603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-8d25b3fd-9f57-4d33-b043-d21483d81c0d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:10.077721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8d25b3fd-9f57-4d33-b043-d21483d81c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:10.116209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:10.147036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1276/2575] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:10.154985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8934320-d35d-40b1-862f-c5877cc6ec30 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.155275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8934320-d35d-40b1-862f-c5877cc6ec30 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.155578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8934320-d35d-40b1-862f-c5877cc6ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.175656 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b8934320-d35d-40b1-862f-c5877cc6ec30 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:10.176867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b8934320-d35d-40b1-862f-c5877cc6ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:10.185441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1300/2576] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:10.189629 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25b3fd-9f57-4d33-b043-d21483d81c0d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:10.199775 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25b3fd-9f57-4d33-b043-d21483d81c0d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:10.204442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096f177-6a4f-44d5-828b-1f6f6bb72694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:10.205043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096f177-6a4f-44d5-828b-1f6f6bb72694 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.205348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096f177-6a4f-44d5-828b-1f6f6bb72694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.205628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096f177-6a4f-44d5-828b-1f6f6bb72694 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.206271 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096f177-6a4f-44d5-828b-1f6f6bb72694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:52:10.206576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096f177-6a4f-44d5-828b-1f6f6bb72694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:10.208200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096f177-6a4f-44d5-828b-1f6f6bb72694 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:10.221153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1277/2577] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:52:10.225263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8934320-d35d-40b1-862f-c5877cc6ec30 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:10.235263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8934320-d35d-40b1-862f-c5877cc6ec30 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:10.239882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a1219-3c7d-4f8b-9536-9c40f01b579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:10.240482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a1219-3c7d-4f8b-9536-9c40f01b579f admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.240757 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a1219-3c7d-4f8b-9536-9c40f01b579f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.241374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a1219-3c7d-4f8b-9536-9c40f01b579f admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.241652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a1219-3c7d-4f8b-9536-9c40f01b579f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:10.244520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a1219-3c7d-4f8b-9536-9c40f01b579f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:10.272569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1301/2578] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:10 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:10.276779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096f177-6a4f-44d5-828b-1f6f6bb72694 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:10.287191 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096f177-6a4f-44d5-828b-1f6f6bb72694 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:10.356662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3f279-27e0-4a5e-9bf0-cf8931f0d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:10.357175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3f279-27e0-4a5e-9bf0-cf8931f0d99e admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.357454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3f279-27e0-4a5e-9bf0-cf8931f0d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.357720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3f279-27e0-4a5e-9bf0-cf8931f0d99e admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.358341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3f279-27e0-4a5e-9bf0-cf8931f0d99e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:10.360286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3f279-27e0-4a5e-9bf0-cf8931f0d99e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:10.382387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1278/2579] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:10 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:10.387067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a1219-3c7d-4f8b-9536-9c40f01b579f admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:10.397553 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a1219-3c7d-4f8b-9536-9c40f01b579f admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:10.402658 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f7bb1-82e0-4d48-bce6-14849a0f3a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:10.403363 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f7bb1-82e0-4d48-bce6-14849a0f3a88 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.403627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f7bb1-82e0-4d48-bce6-14849a0f3a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.403902 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f7bb1-82e0-4d48-bce6-14849a0f3a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.404536 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f7bb1-82e0-4d48-bce6-14849a0f3a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:10.406112 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f7bb1-82e0-4d48-bce6-14849a0f3a88 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:10.416740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1302/2580] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:10.420739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3f279-27e0-4a5e-9bf0-cf8931f0d99e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:10.431049 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3f279-27e0-4a5e-9bf0-cf8931f0d99e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:10.435661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12851157-b6a1-4f72-916a-5fdc09c5331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:10.436255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12851157-b6a1-4f72-916a-5fdc09c5331e admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.436536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12851157-b6a1-4f72-916a-5fdc09c5331e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.436808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12851157-b6a1-4f72-916a-5fdc09c5331e admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.437447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12851157-b6a1-4f72-916a-5fdc09c5331e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:10.439068 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12851157-b6a1-4f72-916a-5fdc09c5331e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:10.449820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1279/2581] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:10.453956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f7bb1-82e0-4d48-bce6-14849a0f3a88 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:10.464734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f7bb1-82e0-4d48-bce6-14849a0f3a88 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:10.469355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f017da-76c2-4d72-bb43-ac6ac502a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:10.469990 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f017da-76c2-4d72-bb43-ac6ac502a8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.470268 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f017da-76c2-4d72-bb43-ac6ac502a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.470542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f017da-76c2-4d72-bb43-ac6ac502a8e3 admin admin] PATH_INFO: `/v3/projects/1dc29d444d854c6098c77d6c81983d0e/users/277c098babcb44dc9f348657e375b3dd/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.472785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:10.488764 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f017da-76c2-4d72-bb43-ac6ac502a8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc29d444d854c6098c77d6c81983d0e, user_id=277c098babcb44dc9f348657e375b3dd, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:10.491472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f017da-76c2-4d72-bb43-ac6ac502a8e3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:10.505520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1303/2582] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:10 2022] PUT /identity/v3/projects/1dc29d444d854c6098c77d6c81983d0e/users/277c098babcb44dc9f348657e375b3dd/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:10.518029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994441-b388-48a4-a011-ec525de227c7 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.518547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994441-b388-48a4-a011-ec525de227c7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.518964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994441-b388-48a4-a011-ec525de227c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.551981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-02994441-b388-48a4-a011-ec525de227c7 None None] MFA Rules not processed for user `277c098babcb44dc9f348657e375b3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:10.553235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-02994441-b388-48a4-a011-ec525de227c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:10.617280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1280/2583] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:10.628755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f017da-76c2-4d72-bb43-ac6ac502a8e3 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:10.630455 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f2f017da-76c2-4d72-bb43-ac6ac502a8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:10.692180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f017da-76c2-4d72-bb43-ac6ac502a8e3 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:10.696196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257c6e9-0565-4c29-af5f-8e023a4bc070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:10.696946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257c6e9-0565-4c29-af5f-8e023a4bc070 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.697230 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257c6e9-0565-4c29-af5f-8e023a4bc070 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.697514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257c6e9-0565-4c29-af5f-8e023a4bc070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.706956 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257c6e9-0565-4c29-af5f-8e023a4bc070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:10.708432 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257c6e9-0565-4c29-af5f-8e023a4bc070 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:10.719855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1304/2584] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:10.742196 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994441-b388-48a4-a011-ec525de227c7 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:10.778478 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:10.807721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994441-b388-48a4-a011-ec525de227c7 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:10.812606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:10.813243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.813519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.813787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] PATH_INFO: `/v3/users/277c098babcb44dc9f348657e375b3dd` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.814970 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277c098babcb44dc9f348657e375b3dd)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:10.816887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:10.865288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277c098babcb44dc9f348657e375b3dd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.873400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277c098babcb44dc9f348657e375b3dd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.874036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277c098babcb44dc9f348657e375b3dd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.885871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277c098babcb44dc9f348657e375b3dd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.886522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277c098babcb44dc9f348657e375b3dd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:10.904525 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1281/2585] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:10 2022] DELETE /identity/v3/users/277c098babcb44dc9f348657e375b3dd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:10.909233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c127afd-ca1c-455d-9eb9-b31a7356d3c2 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:10.909721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c127afd-ca1c-455d-9eb9-b31a7356d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:10.909824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c127afd-ca1c-455d-9eb9-b31a7356d3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:10.934568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9c127afd-ca1c-455d-9eb9-b31a7356d3c2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:10.936045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9c127afd-ca1c-455d-9eb9-b31a7356d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:11.011484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1305/2586] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:52:11.025389 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:11.028043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:11.095339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1246fd-2918-4113-8887-52a321329de7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:11.099155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcacfb-1a99-4db6-a063-9dc622bef479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:11.099768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcacfb-1a99-4db6-a063-9dc622bef479 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:11.100050 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcacfb-1a99-4db6-a063-9dc622bef479 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:11.100348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcacfb-1a99-4db6-a063-9dc622bef479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:11.111035 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcacfb-1a99-4db6-a063-9dc622bef479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:11.112615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcacfb-1a99-4db6-a063-9dc622bef479 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:11.124094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1282/2587] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:11.555430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c127afd-ca1c-455d-9eb9-b31a7356d3c2 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:11.557001 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9c127afd-ca1c-455d-9eb9-b31a7356d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:11.568914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c127afd-ca1c-455d-9eb9-b31a7356d3c2 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:11.574222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:11.574893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:11.575174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:11.575487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] PATH_INFO: `/v3/projects/1dc29d444d854c6098c77d6c81983d0e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:11.576578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc29d444d854c6098c77d6c81983d0e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:11.578515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:11.640151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc29d444d854c6098c77d6c81983d0e', 'request_id': 'req-65254e35-8e58-47ab-ae94-ec94f6dc0c22'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:11.650184 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc29d444d854c6098c77d6c81983d0e', 'request_id': 'req-65254e35-8e58-47ab-ae94-ec94f6dc0c22'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:11.658053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc29d444d854c6098c77d6c81983d0e', 'request_id': 'req-65254e35-8e58-47ab-ae94-ec94f6dc0c22'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:11.675453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] The token cache is being invalidate because project 1dc29d444d854c6098c77d6c81983d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:11.676317 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:11.687930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-65254e35-8e58-47ab-ae94-ec94f6dc0c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:11.691334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1306/2588] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:11 2022] DELETE /identity/v3/projects/1dc29d444d854c6098c77d6c81983d0e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:11.699380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391af718-b378-4d35-851e-520a39e47ddd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:11.699380 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391af718-b378-4d35-851e-520a39e47ddd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:11.700729 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391af718-b378-4d35-851e-520a39e47ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:11.726628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-391af718-b378-4d35-851e-520a39e47ddd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:11.728280 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-391af718-b378-4d35-851e-520a39e47ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:11.782649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:11.796551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1283/2589] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:11.804485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607eada-71ca-4563-aa3a-7ac30fb515c0 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:11.804777 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607eada-71ca-4563-aa3a-7ac30fb515c0 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:11.805094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607eada-71ca-4563-aa3a-7ac30fb515c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:11.825861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-b607eada-71ca-4563-aa3a-7ac30fb515c0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:11.827182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b607eada-71ca-4563-aa3a-7ac30fb515c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:11.835138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1307/2590] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:11.840192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391af718-b378-4d35-851e-520a39e47ddd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:11.850067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391af718-b378-4d35-851e-520a39e47ddd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:11.855360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d936d70-38f0-41c2-b53c-95623240a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:11.855963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d936d70-38f0-41c2-b53c-95623240a7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:11.856239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d936d70-38f0-41c2-b53c-95623240a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:11.856508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d936d70-38f0-41c2-b53c-95623240a7f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:11.857148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d936d70-38f0-41c2-b53c-95623240a7f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:52:11.857445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d936d70-38f0-41c2-b53c-95623240a7f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:11.859044 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d936d70-38f0-41c2-b53c-95623240a7f9 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:11.873788 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1284/2591] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:52:11.877979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607eada-71ca-4563-aa3a-7ac30fb515c0 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:11.882514 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:11.888188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607eada-71ca-4563-aa3a-7ac30fb515c0 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:11.895609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0100224-e208-415d-86ea-686ccecafbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:11.896304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0100224-e208-415d-86ea-686ccecafbff admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:11.896742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0100224-e208-415d-86ea-686ccecafbff admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:11.897067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0100224-e208-415d-86ea-686ccecafbff admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:11.897860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0100224-e208-415d-86ea-686ccecafbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:11.900617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0100224-e208-415d-86ea-686ccecafbff admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:11.935916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1308/2592] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:11 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:11.939709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d936d70-38f0-41c2-b53c-95623240a7f9 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:11.951367 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d936d70-38f0-41c2-b53c-95623240a7f9 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:12.008826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da26ea-d4ec-48e1-898b-a317059a9c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:12.009429 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da26ea-d4ec-48e1-898b-a317059a9c60 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:12.009705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da26ea-d4ec-48e1-898b-a317059a9c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:12.009973 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da26ea-d4ec-48e1-898b-a317059a9c60 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:12.010603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da26ea-d4ec-48e1-898b-a317059a9c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:12.012522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da26ea-d4ec-48e1-898b-a317059a9c60 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:12.034317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1285/2593] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:11 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:12.038478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0100224-e208-415d-86ea-686ccecafbff admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:12.050560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0100224-e208-415d-86ea-686ccecafbff admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:12.055917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22174-1838-4931-8836-ba9d4c9f62e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:12.056596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22174-1838-4931-8836-ba9d4c9f62e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:12.057093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22174-1838-4931-8836-ba9d4c9f62e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:12.057367 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22174-1838-4931-8836-ba9d4c9f62e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:12.058005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22174-1838-4931-8836-ba9d4c9f62e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:12.059621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22174-1838-4931-8836-ba9d4c9f62e1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:12.071596 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1309/2594] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:12.076132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da26ea-d4ec-48e1-898b-a317059a9c60 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:12.090187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da26ea-d4ec-48e1-898b-a317059a9c60 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:12.095200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb1518-f884-4e22-ac78-1e1f1f516365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:12.096026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb1518-f884-4e22-ac78-1e1f1f516365 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:12.096381 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb1518-f884-4e22-ac78-1e1f1f516365 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:12.097376 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb1518-f884-4e22-ac78-1e1f1f516365 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:12.097944 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb1518-f884-4e22-ac78-1e1f1f516365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:12.099851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb1518-f884-4e22-ac78-1e1f1f516365 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:12.116899 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1286/2595] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:12.119608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22174-1838-4931-8836-ba9d4c9f62e1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:12.133277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22174-1838-4931-8836-ba9d4c9f62e1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:12.139344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be3014-5055-4b2c-9b07-16b0800f4515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:12.140147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be3014-5055-4b2c-9b07-16b0800f4515 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:12.140778 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be3014-5055-4b2c-9b07-16b0800f4515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:12.141283 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be3014-5055-4b2c-9b07-16b0800f4515 admin admin] PATH_INFO: `/v3/projects/39bb896fadee4c6c996a757583fc544b/users/b6ec8b0dd8fa4419ab0dc56c9d2a38ae/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:12.172937 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be3014-5055-4b2c-9b07-16b0800f4515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39bb896fadee4c6c996a757583fc544b, user_id=b6ec8b0dd8fa4419ab0dc56c9d2a38ae, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:12.175705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be3014-5055-4b2c-9b07-16b0800f4515 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:12.205196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1310/2596] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:12 2022] PUT /identity/v3/projects/39bb896fadee4c6c996a757583fc544b/users/b6ec8b0dd8fa4419ab0dc56c9d2a38ae/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:12.209371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ff329-3e02-4a2d-8310-84a9a55586aa None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:12.209686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ff329-3e02-4a2d-8310-84a9a55586aa None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:12.209962 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ff329-3e02-4a2d-8310-84a9a55586aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:12.237713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-705ff329-3e02-4a2d-8310-84a9a55586aa None None] MFA Rules not processed for user `b6ec8b0dd8fa4419ab0dc56c9d2a38ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:12.238960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-705ff329-3e02-4a2d-8310-84a9a55586aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:12.305581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1287/2597] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:12.319140 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be3014-5055-4b2c-9b07-16b0800f4515 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:12.320888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-88be3014-5055-4b2c-9b07-16b0800f4515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:12.378211 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be3014-5055-4b2c-9b07-16b0800f4515 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:12.381910 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8a6d-a726-4600-86b7-2868aa0e9d28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3bd33cac7d4715bede59def04cdb92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:12.382509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8a6d-a726-4600-86b7-2868aa0e9d28 service glance] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:12.382809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8a6d-a726-4600-86b7-2868aa0e9d28 service glance] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:12.383102 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8a6d-a726-4600-86b7-2868aa0e9d28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:12.391953 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a8a6d-a726-4600-86b7-2868aa0e9d28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:12.393425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a8a6d-a726-4600-86b7-2868aa0e9d28 service glance] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:12.402557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1311/2598] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:13.256569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b248e-f2e3-406e-a98e-1c39e719e18c None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:13.257076 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b248e-f2e3-406e-a98e-1c39e719e18c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:13.257189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b248e-f2e3-406e-a98e-1c39e719e18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:13.276220 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-e27b248e-f2e3-406e-a98e-1c39e719e18c None None] MFA Rules not processed for user `06fd5308ebe14990b5a146a91c9a380b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:13.277430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e27b248e-f2e3-406e-a98e-1c39e719e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:13.327459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:13.339409 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1288/2599] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:22.398651 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:23.334682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:23.934072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8a6d-a726-4600-86b7-2868aa0e9d28 service glance] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:23.935647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f72a8a6d-a726-4600-86b7-2868aa0e9d28 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:24.004391 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8a6d-a726-4600-86b7-2868aa0e9d28 service glance] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:24.009299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:24.009959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:24.010241 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:24.010517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] PATH_INFO: `/v3/users/d6f682aad5bb4943a72f5c3fe2391816` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:24.011690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f682aad5bb4943a72f5c3fe2391816)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:24.013644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:24.063861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f682aad5bb4943a72f5c3fe2391816'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.064522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f682aad5bb4943a72f5c3fe2391816'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.065132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f682aad5bb4943a72f5c3fe2391816'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.072470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f682aad5bb4943a72f5c3fe2391816'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.080484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f682aad5bb4943a72f5c3fe2391816'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.104501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1312/2600] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:23 2022] DELETE /identity/v3/users/d6f682aad5bb4943a72f5c3fe2391816 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:24.110025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa998-79ed-40fd-9183-5a56b7d15169 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:24.110685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa998-79ed-40fd-9183-5a56b7d15169 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:24.111074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa998-79ed-40fd-9183-5a56b7d15169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:24.135578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-be0aa998-79ed-40fd-9183-5a56b7d15169 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:24.135578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-be0aa998-79ed-40fd-9183-5a56b7d15169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:24.213351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1289/2601] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:52:24.223824 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:24.225538 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:24.292566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4535f5-7b93-478b-a6ea-9e24154c3b96 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:24.296476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f92f0-e251-4531-865e-00274d66a4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:24.297174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f92f0-e251-4531-865e-00274d66a4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:24.297451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f92f0-e251-4531-865e-00274d66a4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:24.297762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f92f0-e251-4531-865e-00274d66a4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:24.307079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f92f0-e251-4531-865e-00274d66a4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:24.308757 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f92f0-e251-4531-865e-00274d66a4a9 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:24.319800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1313/2602] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:24.847800 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa998-79ed-40fd-9183-5a56b7d15169 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:24.849189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-be0aa998-79ed-40fd-9183-5a56b7d15169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:24.863257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa998-79ed-40fd-9183-5a56b7d15169 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:24.869934 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:24.870673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:24.871046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:24.871385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] PATH_INFO: `/v3/projects/938853dc42a74e78880d667b1b3851fc` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:24.872757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938853dc42a74e78880d667b1b3851fc)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:24.875604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:24.930136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938853dc42a74e78880d667b1b3851fc', 'request_id': 'req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.938940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938853dc42a74e78880d667b1b3851fc', 'request_id': 'req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.944801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938853dc42a74e78880d667b1b3851fc', 'request_id': 'req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.957957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] The token cache is being invalidate because project 938853dc42a74e78880d667b1b3851fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:24.958247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.959399 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ebda4d8a-544e-4ef2-a578-b90f458ff1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:24.963913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1290/2603] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:24 2022] DELETE /identity/v3/projects/938853dc42a74e78880d667b1b3851fc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:24.965921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e727-6660-478c-b9f5-378b57ba25f5 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:24.966380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e727-6660-478c-b9f5-378b57ba25f5 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:24.966663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e727-6660-478c-b9f5-378b57ba25f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:24.986561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-03a5e727-6660-478c-b9f5-378b57ba25f5 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:24.987984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-03a5e727-6660-478c-b9f5-378b57ba25f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:25.008929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:25.059175 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1314/2604] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:25.067820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37c328-be92-442a-aac0-33d3bee420f6 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.068136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37c328-be92-442a-aac0-33d3bee420f6 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.068382 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37c328-be92-442a-aac0-33d3bee420f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.088052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-dd37c328-be92-442a-aac0-33d3bee420f6 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:25.089272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-dd37c328-be92-442a-aac0-33d3bee420f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:25.097795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1291/2605] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:25.102846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5e727-6660-478c-b9f5-378b57ba25f5 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:25.112393 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5e727-6660-478c-b9f5-378b57ba25f5 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:25.117828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a927d4b-0fdb-457f-a951-ae35c6d2d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:25.118484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927d4b-0fdb-457f-a951-ae35c6d2d478 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.118721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927d4b-0fdb-457f-a951-ae35c6d2d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.119022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927d4b-0fdb-457f-a951-ae35c6d2d478 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.119702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a927d4b-0fdb-457f-a951-ae35c6d2d478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:52:25.119973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a927d4b-0fdb-457f-a951-ae35c6d2d478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:25.121581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a927d4b-0fdb-457f-a951-ae35c6d2d478 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:25.134225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1315/2606] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:52:25.138580 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37c328-be92-442a-aac0-33d3bee420f6 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:25.149110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37c328-be92-442a-aac0-33d3bee420f6 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:25.154096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd6475-3201-408f-ab90-1c9969d40184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:25.154696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd6475-3201-408f-ab90-1c9969d40184 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.155018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd6475-3201-408f-ab90-1c9969d40184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.155286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd6475-3201-408f-ab90-1c9969d40184 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.155932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd6475-3201-408f-ab90-1c9969d40184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:25.157820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd6475-3201-408f-ab90-1c9969d40184 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:25.198371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1292/2607] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:25 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:25.200385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a927d4b-0fdb-457f-a951-ae35c6d2d478 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:25.212765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a927d4b-0fdb-457f-a951-ae35c6d2d478 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:25.275770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a0e12-3883-49f5-9670-4dae2c6f485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:25.276389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0e12-3883-49f5-9670-4dae2c6f485d admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.276671 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0e12-3883-49f5-9670-4dae2c6f485d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.277027 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0e12-3883-49f5-9670-4dae2c6f485d admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.277579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a0e12-3883-49f5-9670-4dae2c6f485d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:25.279517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a0e12-3883-49f5-9670-4dae2c6f485d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:25.304770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1316/2608] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:25 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:25.308771 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd6475-3201-408f-ab90-1c9969d40184 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:25.325488 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd6475-3201-408f-ab90-1c9969d40184 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:25.330255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474b010-4575-4f78-baa6-0daede11f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:25.330906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474b010-4575-4f78-baa6-0daede11f297 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.331175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474b010-4575-4f78-baa6-0daede11f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.331442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474b010-4575-4f78-baa6-0daede11f297 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.332114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474b010-4575-4f78-baa6-0daede11f297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:25.333687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474b010-4575-4f78-baa6-0daede11f297 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:25.345195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1293/2609] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:25.349224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a0e12-3883-49f5-9670-4dae2c6f485d admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:25.361067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a0e12-3883-49f5-9670-4dae2c6f485d admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:25.365913 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c15f5-9ba5-4861-a4d2-2a8103c6f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:25.366379 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c15f5-9ba5-4861-a4d2-2a8103c6f1dc admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.366662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c15f5-9ba5-4861-a4d2-2a8103c6f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.367222 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c15f5-9ba5-4861-a4d2-2a8103c6f1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.367837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c15f5-9ba5-4861-a4d2-2a8103c6f1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:25.369438 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c15f5-9ba5-4861-a4d2-2a8103c6f1dc admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:25.384509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1317/2610] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:25.385694 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474b010-4575-4f78-baa6-0daede11f297 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:25.400047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474b010-4575-4f78-baa6-0daede11f297 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:25.405462 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84100c57-675b-4571-b5c9-6baf15a0aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:25.405913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84100c57-675b-4571-b5c9-6baf15a0aa42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.406152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84100c57-675b-4571-b5c9-6baf15a0aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.406459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84100c57-675b-4571-b5c9-6baf15a0aa42 admin admin] PATH_INFO: `/v3/projects/d0f280fea36f4e1e860e489d34aee70d/users/f111f756f37c45e1b575ba2da90311f7/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.406634 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c15f5-9ba5-4861-a4d2-2a8103c6f1dc admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:25.408406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-511c15f5-9ba5-4861-a4d2-2a8103c6f1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:25.422949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84100c57-675b-4571-b5c9-6baf15a0aa42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f280fea36f4e1e860e489d34aee70d, user_id=f111f756f37c45e1b575ba2da90311f7, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:25.425592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84100c57-675b-4571-b5c9-6baf15a0aa42 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:25.441461 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1294/2611] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:25 2022] PUT /identity/v3/projects/d0f280fea36f4e1e860e489d34aee70d/users/f111f756f37c45e1b575ba2da90311f7/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:52:25.447536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68bde-79bd-4a59-a8c5-c6aa0a689229 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.447822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68bde-79bd-4a59-a8c5-c6aa0a689229 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.448094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68bde-79bd-4a59-a8c5-c6aa0a689229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.466844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-7ae68bde-79bd-4a59-a8c5-c6aa0a689229 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:25.468142 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7ae68bde-79bd-4a59-a8c5-c6aa0a689229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:25.471004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c15f5-9ba5-4861-a4d2-2a8103c6f1dc admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:25.486320 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:25.521878 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:25.534646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:25.535446 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.536185 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.536529 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.539752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:25.542001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1295/2612] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:25.553179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae68bde-79bd-4a59-a8c5-c6aa0a689229 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:25.565299 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:25.566755 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:25.567581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae68bde-79bd-4a59-a8c5-c6aa0a689229 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:25.572913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d824967-dcba-46cb-9437-5805de16d538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:25.573873 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824967-dcba-46cb-9437-5805de16d538 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:25.574157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824967-dcba-46cb-9437-5805de16d538 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:25.574432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824967-dcba-46cb-9437-5805de16d538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:25.587998 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d824967-dcba-46cb-9437-5805de16d538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:25.589658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d824967-dcba-46cb-9437-5805de16d538 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:25.590563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1318/2613] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:52:25.602371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1296/2614] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:52:29.368505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:29.369644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:29.393166 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d213e-1b30-4980-a2fc-f34a2e586ef0 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:29.403626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:29.404293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:29.404578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:29.404852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] PATH_INFO: `/v3/users/b6ec8b0dd8fa4419ab0dc56c9d2a38ae` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:29.408440 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ec8b0dd8fa4419ab0dc56c9d2a38ae)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:29.419378 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:29.546590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ec8b0dd8fa4419ab0dc56c9d2a38ae'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:29.547406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ec8b0dd8fa4419ab0dc56c9d2a38ae'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:29.549035 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ec8b0dd8fa4419ab0dc56c9d2a38ae'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:29.567312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ec8b0dd8fa4419ab0dc56c9d2a38ae'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:29.584348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ec8b0dd8fa4419ab0dc56c9d2a38ae'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:29.621962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1319/2615] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:29 2022] DELETE /identity/v3/users/b6ec8b0dd8fa4419ab0dc56c9d2a38ae => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:29.626209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100b766-9bb5-4b9d-bbab-61f32959e06a None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:29.626745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100b766-9bb5-4b9d-bbab-61f32959e06a None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:29.626745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100b766-9bb5-4b9d-bbab-61f32959e06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:29.649638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5100b766-9bb5-4b9d-bbab-61f32959e06a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:29.651217 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5100b766-9bb5-4b9d-bbab-61f32959e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:29.743257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1297/2616] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:29.782724 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:29.784541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:29.942737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782676d1-ab82-4641-bd7c-6db2be2387b1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:29.948511 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5afdaa-2331-4cbe-8929-05ca06b23a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:29.949978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5afdaa-2331-4cbe-8929-05ca06b23a4b service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:29.951882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5afdaa-2331-4cbe-8929-05ca06b23a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:29.951882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5afdaa-2331-4cbe-8929-05ca06b23a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:29.975526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5afdaa-2331-4cbe-8929-05ca06b23a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:29.977139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5afdaa-2331-4cbe-8929-05ca06b23a4b service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:30.002608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1320/2617] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:30.642689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100b766-9bb5-4b9d-bbab-61f32959e06a None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:30.644173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5100b766-9bb5-4b9d-bbab-61f32959e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:30.659965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100b766-9bb5-4b9d-bbab-61f32959e06a None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:30.665890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:30.666938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:30.667379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:30.667798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] PATH_INFO: `/v3/users/2f4ede1576cf4669b3a3c46d30f62f73` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:30.669400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4ede1576cf4669b3a3c46d30f62f73)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:30.671753 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:30.734130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4ede1576cf4669b3a3c46d30f62f73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:30.747323 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4ede1576cf4669b3a3c46d30f62f73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:30.749878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4ede1576cf4669b3a3c46d30f62f73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:30.780755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4ede1576cf4669b3a3c46d30f62f73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:30.784094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-2275b141-f35e-410a-ac52-0a85d72cbe64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4ede1576cf4669b3a3c46d30f62f73'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:30.805109 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1298/2618] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:30 2022] DELETE /identity/v3/users/2f4ede1576cf4669b3a3c46d30f62f73 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:30.807534 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5afdaa-2331-4cbe-8929-05ca06b23a4b service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:30.809382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3b5afdaa-2331-4cbe-8929-05ca06b23a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:30.826097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5afdaa-2331-4cbe-8929-05ca06b23a4b service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:30.934484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:30.938923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:30.938923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:30.938923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] PATH_INFO: `/v3/projects/39bb896fadee4c6c996a757583fc544b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:30.943138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39bb896fadee4c6c996a757583fc544b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:30.949077 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:30.958281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:31.063918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39bb896fadee4c6c996a757583fc544b', 'request_id': 'req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.072397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39bb896fadee4c6c996a757583fc544b', 'request_id': 'req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.080817 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39bb896fadee4c6c996a757583fc544b', 'request_id': 'req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.099193 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] The token cache is being invalidate because project 39bb896fadee4c6c996a757583fc544b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:31.099619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.100491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.107461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1321/2619] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:30 2022] DELETE /identity/v3/projects/39bb896fadee4c6c996a757583fc544b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:31.118740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3418a2-8f8b-4d1b-bc21-206070802622 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.119673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3418a2-8f8b-4d1b-bc21-206070802622 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.120162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3418a2-8f8b-4d1b-bc21-206070802622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.148825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-0a3418a2-8f8b-4d1b-bc21-206070802622 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:31.150561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-0a3418a2-8f8b-4d1b-bc21-206070802622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:31.167414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:31.169159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:31.196468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:31.314902 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1299/2620] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:31.327740 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eee96-f97b-4d6d-bbeb-58101d7c5806 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.328375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eee96-f97b-4d6d-bbeb-58101d7c5806 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.328911 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eee96-f97b-4d6d-bbeb-58101d7c5806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.370384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3dda-c7d7-4e7b-8182-e8a95cf02a43 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:31.377754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:31.378415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.378695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.379017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] PATH_INFO: `/v3/projects/c88b730834c148a785026ca77cfa2afb` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.380186 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88b730834c148a785026ca77cfa2afb)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:31.383923 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:31.396500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-8a6eee96-f97b-4d6d-bbeb-58101d7c5806 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:31.398879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8a6eee96-f97b-4d6d-bbeb-58101d7c5806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:31.412153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1300/2621] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:31.417782 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eee96-f97b-4d6d-bbeb-58101d7c5806 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:31.431443 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eee96-f97b-4d6d-bbeb-58101d7c5806 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:31.443180 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f557c7-9f85-4d97-a6f6-6945424d8cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:31.443974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f557c7-9f85-4d97-a6f6-6945424d8cbc admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.444282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f557c7-9f85-4d97-a6f6-6945424d8cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.445287 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f557c7-9f85-4d97-a6f6-6945424d8cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.446094 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f557c7-9f85-4d97-a6f6-6945424d8cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:52:31.446685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f557c7-9f85-4d97-a6f6-6945424d8cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:31.448630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f557c7-9f85-4d97-a6f6-6945424d8cbc admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:31.472289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1301/2622] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:52:31.473431 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f557c7-9f85-4d97-a6f6-6945424d8cbc admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:31.486081 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88b730834c148a785026ca77cfa2afb', 'request_id': 'req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.495482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f557c7-9f85-4d97-a6f6-6945424d8cbc admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:31.501183 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88b730834c148a785026ca77cfa2afb', 'request_id': 'req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.509247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88b730834c148a785026ca77cfa2afb', 'request_id': 'req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.536895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] The token cache is being invalidate because project c88b730834c148a785026ca77cfa2afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:31.537194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.540572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-aee8f423-cd4a-4501-ad89-8649ef6c2ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:31.545945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1322/2623] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:31 2022] DELETE /identity/v3/projects/c88b730834c148a785026ca77cfa2afb => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:31.550886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d07f-1355-4df1-8f19-7c83f37ad417 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.551143 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d07f-1355-4df1-8f19-7c83f37ad417 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.551420 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d07f-1355-4df1-8f19-7c83f37ad417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.607394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-da89d07f-1355-4df1-8f19-7c83f37ad417 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:31.611649 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-da89d07f-1355-4df1-8f19-7c83f37ad417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:31.651890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d890961-05fe-4d74-b35a-3579829e4726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:31.658026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d890961-05fe-4d74-b35a-3579829e4726 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.658197 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d890961-05fe-4d74-b35a-3579829e4726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.658436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d890961-05fe-4d74-b35a-3579829e4726 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.659125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d890961-05fe-4d74-b35a-3579829e4726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:31.661061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d890961-05fe-4d74-b35a-3579829e4726 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:31.689347 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:31.748585 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1302/2624] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:31 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:31.753039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d890961-05fe-4d74-b35a-3579829e4726 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:31.754946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1d890961-05fe-4d74-b35a-3579829e4726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:31.811360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1323/2625] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:52:31.820022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73efb5-c190-4369-bb41-29c10f7ac8f8 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.822669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73efb5-c190-4369-bb41-29c10f7ac8f8 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.823064 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73efb5-c190-4369-bb41-29c10f7ac8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.863918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ab73efb5-c190-4369-bb41-29c10f7ac8f8 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:31.865915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ab73efb5-c190-4369-bb41-29c10f7ac8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:31.874041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d890961-05fe-4d74-b35a-3579829e4726 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:31.879853 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41011df2-0e4d-43c9-a2b4-fa820e4837cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:31.882961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41011df2-0e4d-43c9-a2b4-fa820e4837cf admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.883475 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41011df2-0e4d-43c9-a2b4-fa820e4837cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.884654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41011df2-0e4d-43c9-a2b4-fa820e4837cf admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.884860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1324/2626] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:52:31.885887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73efb5-c190-4369-bb41-29c10f7ac8f8 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:31.886260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41011df2-0e4d-43c9-a2b4-fa820e4837cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:31.889183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41011df2-0e4d-43c9-a2b4-fa820e4837cf admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:31.899054 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73efb5-c190-4369-bb41-29c10f7ac8f8 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:31.904351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dfbaf-9547-4fdd-af5b-25bc7c94abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:31.905228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dfbaf-9547-4fdd-af5b-25bc7c94abe1 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.905833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dfbaf-9547-4fdd-af5b-25bc7c94abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.906630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dfbaf-9547-4fdd-af5b-25bc7c94abe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.907734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dfbaf-9547-4fdd-af5b-25bc7c94abe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:52:31.908203 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dfbaf-9547-4fdd-af5b-25bc7c94abe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:31.910331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dfbaf-9547-4fdd-af5b-25bc7c94abe1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:31.938820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1303/2627] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:31 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:52:31.944406 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41011df2-0e4d-43c9-a2b4-fa820e4837cf admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:31.945828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1325/2628] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:52:31.952794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dfbaf-9547-4fdd-af5b-25bc7c94abe1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:31.964999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dfbaf-9547-4fdd-af5b-25bc7c94abe1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:31.965964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41011df2-0e4d-43c9-a2b4-fa820e4837cf admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:31.976332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505e0fe-c6b6-4b12-a4cb-4c9c05b56daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:31.977551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e0fe-c6b6-4b12-a4cb-4c9c05b56daa admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.978236 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e0fe-c6b6-4b12-a4cb-4c9c05b56daa admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.978746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e0fe-c6b6-4b12-a4cb-4c9c05b56daa admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.979697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505e0fe-c6b6-4b12-a4cb-4c9c05b56daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:31.981640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076d3ff-e946-4057-9b5c-93505feea718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:31.982366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505e0fe-c6b6-4b12-a4cb-4c9c05b56daa admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:31.982583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076d3ff-e946-4057-9b5c-93505feea718 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:31.982853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076d3ff-e946-4057-9b5c-93505feea718 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:31.983129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076d3ff-e946-4057-9b5c-93505feea718 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:31.983906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076d3ff-e946-4057-9b5c-93505feea718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:31.986855 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076d3ff-e946-4057-9b5c-93505feea718 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:31.998536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1304/2629] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:52:32.000346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505e0fe-c6b6-4b12-a4cb-4c9c05b56daa admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:32.011467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:32.019549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505e0fe-c6b6-4b12-a4cb-4c9c05b56daa admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:32.029258 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5747-d4c7-4e85-94e1-146762f554b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:32.030175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5747-d4c7-4e85-94e1-146762f554b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.030558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5747-d4c7-4e85-94e1-146762f554b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.031071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5747-d4c7-4e85-94e1-146762f554b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.031826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f5747-d4c7-4e85-94e1-146762f554b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:32.034134 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f5747-d4c7-4e85-94e1-146762f554b5 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:32.046969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1326/2630] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:31 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:52:32.048059 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076d3ff-e946-4057-9b5c-93505feea718 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:32.067037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1305/2631] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:52:32.067978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5747-d4c7-4e85-94e1-146762f554b5 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:32.082827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5747-d4c7-4e85-94e1-146762f554b5 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:32.201295 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076d3ff-e946-4057-9b5c-93505feea718 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:32.201669 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f851bc-6cc0-4a03-8dc4-aa6f2ee36aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:32.202352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f851bc-6cc0-4a03-8dc4-aa6f2ee36aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.202635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f851bc-6cc0-4a03-8dc4-aa6f2ee36aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.202946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f851bc-6cc0-4a03-8dc4-aa6f2ee36aa6 admin admin] PATH_INFO: `/v3/projects/b07d55e1442b4cf49384b91993c4f928/users/f2885719bd1343a685cac4c7b22c9ccd/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.213988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe823102-59f1-4bbf-9e5c-f0f1f626e786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:32.214605 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe823102-59f1-4bbf-9e5c-f0f1f626e786 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.214942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe823102-59f1-4bbf-9e5c-f0f1f626e786 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.215216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe823102-59f1-4bbf-9e5c-f0f1f626e786 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.215857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe823102-59f1-4bbf-9e5c-f0f1f626e786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:32.217839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe823102-59f1-4bbf-9e5c-f0f1f626e786 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:32.233183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f851bc-6cc0-4a03-8dc4-aa6f2ee36aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07d55e1442b4cf49384b91993c4f928, user_id=f2885719bd1343a685cac4c7b22c9ccd, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:32.236346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f851bc-6cc0-4a03-8dc4-aa6f2ee36aa6 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:32.255703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1327/2632] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:32 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:32.261122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe823102-59f1-4bbf-9e5c-f0f1f626e786 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:32.263299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1306/2633] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:32 2022] PUT /identity/v3/projects/b07d55e1442b4cf49384b91993c4f928/users/f2885719bd1343a685cac4c7b22c9ccd/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:32.276019 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ce0b0-4039-480d-9f0a-921e421eb7c4 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.276313 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ce0b0-4039-480d-9f0a-921e421eb7c4 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.276405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe823102-59f1-4bbf-9e5c-f0f1f626e786 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:32.276627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ce0b0-4039-480d-9f0a-921e421eb7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.330020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-d52ce0b0-4039-480d-9f0a-921e421eb7c4 None None] MFA Rules not processed for user `f2885719bd1343a685cac4c7b22c9ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:32.331229 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d52ce0b0-4039-480d-9f0a-921e421eb7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:32.372296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d35-cf51-4950-a444-b02d467d2552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:32.372931 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d35-cf51-4950-a444-b02d467d2552 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.373207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d35-cf51-4950-a444-b02d467d2552 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.373476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d35-cf51-4950-a444-b02d467d2552 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.374123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d3d35-cf51-4950-a444-b02d467d2552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:32.375809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d3d35-cf51-4950-a444-b02d467d2552 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:32.390569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1328/2634] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:32.396114 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d35-cf51-4950-a444-b02d467d2552 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:32.412209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d35-cf51-4950-a444-b02d467d2552 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:32.418926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02527d-e4e8-428a-adec-b5fa2e8bb852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:32.419703 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02527d-e4e8-428a-adec-b5fa2e8bb852 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.420055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02527d-e4e8-428a-adec-b5fa2e8bb852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.420334 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02527d-e4e8-428a-adec-b5fa2e8bb852 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.420988 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02527d-e4e8-428a-adec-b5fa2e8bb852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:32.423959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02527d-e4e8-428a-adec-b5fa2e8bb852 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:32.426228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:32.445856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1329/2635] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:32.447228 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02527d-e4e8-428a-adec-b5fa2e8bb852 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:32.452938 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1307/2636] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:52:32.464252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02527d-e4e8-428a-adec-b5fa2e8bb852 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:32.465760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ce0b0-4039-480d-9f0a-921e421eb7c4 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:32.467674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-d52ce0b0-4039-480d-9f0a-921e421eb7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:32.472726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573869b-d0a3-43e3-9e9e-96d607df2a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:32.474008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573869b-d0a3-43e3-9e9e-96d607df2a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.474373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573869b-d0a3-43e3-9e9e-96d607df2a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.474732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573869b-d0a3-43e3-9e9e-96d607df2a47 admin admin] PATH_INFO: `/v3/projects/99343dccee8144ca91b5d94a724df0cb/users/cb4dddb2f6ff422ea087247ed7fc1724/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.495031 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573869b-d0a3-43e3-9e9e-96d607df2a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99343dccee8144ca91b5d94a724df0cb, user_id=cb4dddb2f6ff422ea087247ed7fc1724, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:32.498023 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573869b-d0a3-43e3-9e9e-96d607df2a47 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:32.522457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1330/2637] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:32 2022] PUT /identity/v3/projects/99343dccee8144ca91b5d94a724df0cb/users/cb4dddb2f6ff422ea087247ed7fc1724/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:32.546390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2990e-d7df-49f3-bfde-0e383f6717dc None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.546809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2990e-d7df-49f3-bfde-0e383f6717dc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.547073 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2990e-d7df-49f3-bfde-0e383f6717dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.569107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ce0b0-4039-480d-9f0a-921e421eb7c4 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:32.606759 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:32.631093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-eee2990e-d7df-49f3-bfde-0e383f6717dc None None] MFA Rules not processed for user `cb4dddb2f6ff422ea087247ed7fc1724`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:32.632816 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-eee2990e-d7df-49f3-bfde-0e383f6717dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:32.655837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28691e8-84f0-4e87-8a9c-d33844725d1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3bd33cac7d4715bede59def04cdb92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:32.656503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28691e8-84f0-4e87-8a9c-d33844725d1a service glance] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.657031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28691e8-84f0-4e87-8a9c-d33844725d1a service glance] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.657518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28691e8-84f0-4e87-8a9c-d33844725d1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.728876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1331/2638] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:32.730505 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383e382-7de5-41f5-8e13-3a37d9fe0799 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.730950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383e382-7de5-41f5-8e13-3a37d9fe0799 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.731236 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383e382-7de5-41f5-8e13-3a37d9fe0799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.735531 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28691e8-84f0-4e87-8a9c-d33844725d1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:32.736994 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28691e8-84f0-4e87-8a9c-d33844725d1a service glance] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:32.750432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1308/2639] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:52:32.752507 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c342d-ed7f-4b77-a16d-24454f8989d9 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.752866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c342d-ed7f-4b77-a16d-24454f8989d9 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.753126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c342d-ed7f-4b77-a16d-24454f8989d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.771942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-5383e382-7de5-41f5-8e13-3a37d9fe0799 None None] MFA Rules not processed for user `f111f756f37c45e1b575ba2da90311f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:32.773377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5383e382-7de5-41f5-8e13-3a37d9fe0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:32.779572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b96c342d-ed7f-4b77-a16d-24454f8989d9 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:32.780802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b96c342d-ed7f-4b77-a16d-24454f8989d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:32.864371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1309/2640] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:32.869462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1332/2641] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:32.870882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383e382-7de5-41f5-8e13-3a37d9fe0799 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:32.872730 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5383e382-7de5-41f5-8e13-3a37d9fe0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:32.875447 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c342d-ed7f-4b77-a16d-24454f8989d9 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:32.943558 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:32.963958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383e382-7de5-41f5-8e13-3a37d9fe0799 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:32.969584 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8b368-6e20-4f51-83d2-06d54b177148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:32.970092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c342d-ed7f-4b77-a16d-24454f8989d9 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:32.970232 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8b368-6e20-4f51-83d2-06d54b177148 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.970477 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8b368-6e20-4f51-83d2-06d54b177148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.970748 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8b368-6e20-4f51-83d2-06d54b177148 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.971690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8b368-6e20-4f51-83d2-06d54b177148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:32.973601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8b368-6e20-4f51-83d2-06d54b177148 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:32.975021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174fa1-8d29-4f81-b388-218906c60872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:32.975634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174fa1-8d29-4f81-b388-218906c60872 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:32.975963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174fa1-8d29-4f81-b388-218906c60872 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:32.976247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174fa1-8d29-4f81-b388-218906c60872 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:32.976871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd174fa1-8d29-4f81-b388-218906c60872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:32.978743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd174fa1-8d29-4f81-b388-218906c60872 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.008397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1333/2642] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:32 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:52:33.009248 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8b368-6e20-4f51-83d2-06d54b177148 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.011004 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f9f8b368-6e20-4f51-83d2-06d54b177148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:33.015289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1310/2643] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:32 2022] POST /identity/v3/projects => generated 405 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:33.016072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174fa1-8d29-4f81-b388-218906c60872 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.027129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:33.097225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174fa1-8d29-4f81-b388-218906c60872 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.103257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa611118-1c0a-43e0-b385-bae168debf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.103952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa611118-1c0a-43e0-b385-bae168debf38 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.104233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa611118-1c0a-43e0-b385-bae168debf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.104509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa611118-1c0a-43e0-b385-bae168debf38 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.105140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa611118-1c0a-43e0-b385-bae168debf38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.107084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa611118-1c0a-43e0-b385-bae168debf38 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.116032 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8b368-6e20-4f51-83d2-06d54b177148 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.142513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1311/2644] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:33 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:33.148178 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa611118-1c0a-43e0-b385-bae168debf38 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.159432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa611118-1c0a-43e0-b385-bae168debf38 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.164542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a39b8-605f-4d30-b25c-f03334eb198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.166155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a39b8-605f-4d30-b25c-f03334eb198f admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.166155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a39b8-605f-4d30-b25c-f03334eb198f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.166155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a39b8-605f-4d30-b25c-f03334eb198f admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.166445 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a39b8-605f-4d30-b25c-f03334eb198f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.168408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a39b8-605f-4d30-b25c-f03334eb198f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.191527 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21821e10-174b-4365-80ad-b4ce3779dfa0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.192153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21821e10-174b-4365-80ad-b4ce3779dfa0 service swift] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.192433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21821e10-174b-4365-80ad-b4ce3779dfa0 service swift] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.192710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21821e10-174b-4365-80ad-b4ce3779dfa0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.197329 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1312/2645] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:33 2022] POST /identity/v3/users => generated 309 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:33.198487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a39b8-605f-4d30-b25c-f03334eb198f admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.211284 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a39b8-605f-4d30-b25c-f03334eb198f admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.222344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990f5c-7714-4f3b-9330-3b5f6ad24220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.223297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990f5c-7714-4f3b-9330-3b5f6ad24220 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.223700 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990f5c-7714-4f3b-9330-3b5f6ad24220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.224075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990f5c-7714-4f3b-9330-3b5f6ad24220 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.224683 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70990f5c-7714-4f3b-9330-3b5f6ad24220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.226907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70990f5c-7714-4f3b-9330-3b5f6ad24220 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.242232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1313/2646] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:33.243233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990f5c-7714-4f3b-9330-3b5f6ad24220 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.275654 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990f5c-7714-4f3b-9330-3b5f6ad24220 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.290826 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161287a-f23c-4dcc-a6a5-5d3432284948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.291817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161287a-f23c-4dcc-a6a5-5d3432284948 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.292293 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161287a-f23c-4dcc-a6a5-5d3432284948 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.292575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161287a-f23c-4dcc-a6a5-5d3432284948 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.293262 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161287a-f23c-4dcc-a6a5-5d3432284948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.294290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21821e10-174b-4365-80ad-b4ce3779dfa0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.295933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21821e10-174b-4365-80ad-b4ce3779dfa0 service swift] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.301784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161287a-f23c-4dcc-a6a5-5d3432284948 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.305404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1334/2647] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:52:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:52:33.306342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21821e10-174b-4365-80ad-b4ce3779dfa0 service swift] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.320867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21821e10-174b-4365-80ad-b4ce3779dfa0 service swift] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.327637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347de81c-bb2f-482a-934d-37fcdce469a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.328557 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347de81c-bb2f-482a-934d-37fcdce469a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.328678 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1314/2648] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:33.328765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347de81c-bb2f-482a-934d-37fcdce469a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.328971 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347de81c-bb2f-482a-934d-37fcdce469a8 admin admin] PATH_INFO: `/v3/projects/f679189b5b8f42499ea9d7b1cbe8664e/users/c785ec0dbacc4dbb97a5a9f994bc58bd/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.333745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161287a-f23c-4dcc-a6a5-5d3432284948 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.367372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161287a-f23c-4dcc-a6a5-5d3432284948 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.368646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347de81c-bb2f-482a-934d-37fcdce469a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f679189b5b8f42499ea9d7b1cbe8664e, user_id=c785ec0dbacc4dbb97a5a9f994bc58bd, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.373875 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347de81c-bb2f-482a-934d-37fcdce469a8 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.386685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb362c-4e68-4f63-8569-046aac418b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.386685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb362c-4e68-4f63-8569-046aac418b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.386685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb362c-4e68-4f63-8569-046aac418b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.386685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb362c-4e68-4f63-8569-046aac418b07 admin admin] PATH_INFO: `/v3/projects/1fd2de03103c4a5c9a13e41934e4f98f/users/db50816aecc847ee9101a16ca3784ef8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.387752 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:33.410818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1335/2649] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:33 2022] PUT /identity/v3/projects/f679189b5b8f42499ea9d7b1cbe8664e/users/c785ec0dbacc4dbb97a5a9f994bc58bd/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:33.414725 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347de81c-bb2f-482a-934d-37fcdce469a8 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.427863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb362c-4e68-4f63-8569-046aac418b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd2de03103c4a5c9a13e41934e4f98f, user_id=db50816aecc847ee9101a16ca3784ef8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.432725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb362c-4e68-4f63-8569-046aac418b07 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.459816 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1315/2650] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:33 2022] PUT /identity/v3/projects/1fd2de03103c4a5c9a13e41934e4f98f/users/db50816aecc847ee9101a16ca3784ef8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:33.464564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb362c-4e68-4f63-8569-046aac418b07 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.512110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347de81c-bb2f-482a-934d-37fcdce469a8 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.549965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb362c-4e68-4f63-8569-046aac418b07 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.557465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512f0b1-f65b-480a-b786-a0b5d66ca84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.558226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512f0b1-f65b-480a-b786-a0b5d66ca84f admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.558609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512f0b1-f65b-480a-b786-a0b5d66ca84f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.558922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512f0b1-f65b-480a-b786-a0b5d66ca84f admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.559863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512f0b1-f65b-480a-b786-a0b5d66ca84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.561910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512f0b1-f65b-480a-b786-a0b5d66ca84f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.578503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1316/2651] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:52:33.580130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512f0b1-f65b-480a-b786-a0b5d66ca84f admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.596025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512f0b1-f65b-480a-b786-a0b5d66ca84f admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.613366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a189458-f604-4187-9c36-a17ea95b8f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.618495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a189458-f604-4187-9c36-a17ea95b8f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.618992 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a189458-f604-4187-9c36-a17ea95b8f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.619282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a189458-f604-4187-9c36-a17ea95b8f78 admin admin] PATH_INFO: `/v3/projects/1fd2de03103c4a5c9a13e41934e4f98f/users/db50816aecc847ee9101a16ca3784ef8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.622575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a189458-f604-4187-9c36-a17ea95b8f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd2de03103c4a5c9a13e41934e4f98f, user_id=db50816aecc847ee9101a16ca3784ef8, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.626806 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a189458-f604-4187-9c36-a17ea95b8f78 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.633997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c77038-7aa5-41d4-b707-20a42d49f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.634691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c77038-7aa5-41d4-b707-20a42d49f36e admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.635058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c77038-7aa5-41d4-b707-20a42d49f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.635353 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c77038-7aa5-41d4-b707-20a42d49f36e admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.636235 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c77038-7aa5-41d4-b707-20a42d49f36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.639578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c77038-7aa5-41d4-b707-20a42d49f36e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.658002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1336/2652] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:33.662076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c77038-7aa5-41d4-b707-20a42d49f36e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.671278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1317/2653] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:33 2022] PUT /identity/v3/projects/1fd2de03103c4a5c9a13e41934e4f98f/users/db50816aecc847ee9101a16ca3784ef8/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:33.673085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d0a3b-f84b-4fac-bc70-ca12e84b3115 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.673379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d0a3b-f84b-4fac-bc70-ca12e84b3115 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.673658 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d0a3b-f84b-4fac-bc70-ca12e84b3115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.682734 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c77038-7aa5-41d4-b707-20a42d49f36e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:33.728098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ee9d0a3b-f84b-4fac-bc70-ca12e84b3115 None None] MFA Rules not processed for user `db50816aecc847ee9101a16ca3784ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:33.736606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ee9d0a3b-f84b-4fac-bc70-ca12e84b3115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:33.747106 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:33.814173 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f1e3d-8b7d-4276-8bcf-088d2edb9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:33.815344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f1e3d-8b7d-4276-8bcf-088d2edb9998 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:33.816484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f1e3d-8b7d-4276-8bcf-088d2edb9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:33.816996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f1e3d-8b7d-4276-8bcf-088d2edb9998 admin admin] PATH_INFO: `/v3/projects/f679189b5b8f42499ea9d7b1cbe8664e/users/c785ec0dbacc4dbb97a5a9f994bc58bd/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:33.820474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f1e3d-8b7d-4276-8bcf-088d2edb9998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f679189b5b8f42499ea9d7b1cbe8664e, user_id=c785ec0dbacc4dbb97a5a9f994bc58bd, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:33.824028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f1e3d-8b7d-4276-8bcf-088d2edb9998 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:33.849924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1337/2654] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:33 2022] PUT /identity/v3/projects/f679189b5b8f42499ea9d7b1cbe8664e/users/c785ec0dbacc4dbb97a5a9f994bc58bd/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:52:33.916312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1318/2655] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:33.930822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f1e3d-8b7d-4276-8bcf-088d2edb9998 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:33.932882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-506f1e3d-8b7d-4276-8bcf-088d2edb9998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:34.016750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:34.076053 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f1e3d-8b7d-4276-8bcf-088d2edb9998 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:34.087994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8979f9c-63a3-4fbe-8988-be5a63189a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:34.088908 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979f9c-63a3-4fbe-8988-be5a63189a5b service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:34.089355 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979f9c-63a3-4fbe-8988-be5a63189a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:34.089776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979f9c-63a3-4fbe-8988-be5a63189a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:34.207779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8979f9c-63a3-4fbe-8988-be5a63189a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:34.209332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8979f9c-63a3-4fbe-8988-be5a63189a5b service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:34.222823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1338/2656] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:33 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:34.442901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d0a3b-f84b-4fac-bc70-ca12e84b3115 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:34.466496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d0a3b-f84b-4fac-bc70-ca12e84b3115 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:34.618482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:34.619171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:34.619464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:34.619741 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] PATH_INFO: `/v3/users/cb4dddb2f6ff422ea087247ed7fc1724` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:34.622315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4dddb2f6ff422ea087247ed7fc1724)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:34.629213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:34.772757 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4dddb2f6ff422ea087247ed7fc1724'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:34.791988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4dddb2f6ff422ea087247ed7fc1724'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:34.799561 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4dddb2f6ff422ea087247ed7fc1724'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:34.830022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4dddb2f6ff422ea087247ed7fc1724'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:34.831240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4dddb2f6ff422ea087247ed7fc1724'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:34.868398 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1319/2657] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:34 2022] DELETE /identity/v3/users/cb4dddb2f6ff422ea087247ed7fc1724 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:34.873382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6715e7-f4b8-4c69-933c-bf42db1336e7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:34.873672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6715e7-f4b8-4c69-933c-bf42db1336e7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:34.874018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6715e7-f4b8-4c69-933c-bf42db1336e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:34.932290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6a6715e7-f4b8-4c69-933c-bf42db1336e7 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:34.937754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6a6715e7-f4b8-4c69-933c-bf42db1336e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:35.123984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1339/2658] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:35.134613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:35.136952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:35.221734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:35.305263 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e07a8-f08a-40f1-9eba-0319877d32f2 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:35.310256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996a9a0-ffec-4076-b5a8-a834e387513b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:35.310957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996a9a0-ffec-4076-b5a8-a834e387513b service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:35.311237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996a9a0-ffec-4076-b5a8-a834e387513b service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:35.311825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996a9a0-ffec-4076-b5a8-a834e387513b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:35.325957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996a9a0-ffec-4076-b5a8-a834e387513b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:35.327846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996a9a0-ffec-4076-b5a8-a834e387513b service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:35.344405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1320/2659] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:35.791008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6715e7-f4b8-4c69-933c-bf42db1336e7 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:35.792665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6a6715e7-f4b8-4c69-933c-bf42db1336e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:35.833223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6715e7-f4b8-4c69-933c-bf42db1336e7 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:35.874088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:35.874867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:35.875135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:35.881246 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] PATH_INFO: `/v3/projects/99343dccee8144ca91b5d94a724df0cb` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:35.891844 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99343dccee8144ca91b5d94a724df0cb)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:35.893993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:36.027868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99343dccee8144ca91b5d94a724df0cb', 'request_id': 'req-ebc8567f-f471-4727-bffc-94c0991f3c29'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.039375 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99343dccee8144ca91b5d94a724df0cb', 'request_id': 'req-ebc8567f-f471-4727-bffc-94c0991f3c29'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.050562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99343dccee8144ca91b5d94a724df0cb', 'request_id': 'req-ebc8567f-f471-4727-bffc-94c0991f3c29'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.092684 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] The token cache is being invalidate because project 99343dccee8144ca91b5d94a724df0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:36.092983 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.093652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.095220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1340/2660] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:35 2022] DELETE /identity/v3/projects/99343dccee8144ca91b5d94a724df0cb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:36.099302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996a9a0-ffec-4076-b5a8-a834e387513b service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:36.111374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996a9a0-ffec-4076-b5a8-a834e387513b service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:36.250013 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:36.250719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:36.251027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:36.251341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] PATH_INFO: `/v3/users/db50816aecc847ee9101a16ca3784ef8` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:36.252720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db50816aecc847ee9101a16ca3784ef8)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:36.254880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:36.415306 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db50816aecc847ee9101a16ca3784ef8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.433499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db50816aecc847ee9101a16ca3784ef8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.434436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db50816aecc847ee9101a16ca3784ef8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.452660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db50816aecc847ee9101a16ca3784ef8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.453789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c356b573-af3a-43ea-8906-4debe3acf91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db50816aecc847ee9101a16ca3784ef8'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:36.495708 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1321/2661] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:36 2022] DELETE /identity/v3/users/db50816aecc847ee9101a16ca3784ef8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:37.318276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:37.321969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:37.398036 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8567f-f471-4727-bffc-94c0991f3c29 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:37.407732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:37.486377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:37.487313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:37.487704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:37.488083 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] PATH_INFO: `/v3/projects/1fd2de03103c4a5c9a13e41934e4f98f` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:37.489607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd2de03103c4a5c9a13e41934e4f98f)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:37.492309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:37.574515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd2de03103c4a5c9a13e41934e4f98f', 'request_id': 'req-8728640c-90fb-478b-8bdf-78849608b294'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:37.587330 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd2de03103c4a5c9a13e41934e4f98f', 'request_id': 'req-8728640c-90fb-478b-8bdf-78849608b294'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:37.616574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd2de03103c4a5c9a13e41934e4f98f', 'request_id': 'req-8728640c-90fb-478b-8bdf-78849608b294'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:37.653022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] The token cache is being invalidate because project 1fd2de03103c4a5c9a13e41934e4f98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:37.654447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:37.656582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8728640c-90fb-478b-8bdf-78849608b294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:37.659880 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1341/2662] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:37 2022] DELETE /identity/v3/projects/1fd2de03103c4a5c9a13e41934e4f98f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:37.665207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f1118-eab8-41cd-bdc8-69fc6bd3ce68 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:37.665913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f1118-eab8-41cd-bdc8-69fc6bd3ce68 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:37.665913 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f1118-eab8-41cd-bdc8-69fc6bd3ce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:37.698524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-410f1118-eab8-41cd-bdc8-69fc6bd3ce68 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:37.700468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-410f1118-eab8-41cd-bdc8-69fc6bd3ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:37.868309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:37.979967 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1322/2663] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:37.982687 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436713f8-08ea-4122-a39c-5c3ad1297527 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:37.983746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436713f8-08ea-4122-a39c-5c3ad1297527 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:37.983746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436713f8-08ea-4122-a39c-5c3ad1297527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:38.037496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-436713f8-08ea-4122-a39c-5c3ad1297527 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:38.040226 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-436713f8-08ea-4122-a39c-5c3ad1297527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:38.071492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1342/2664] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:38.075854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f1118-eab8-41cd-bdc8-69fc6bd3ce68 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:38.090545 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f1118-eab8-41cd-bdc8-69fc6bd3ce68 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:38.098046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa4c9d-88ff-4b63-8683-b7b47e463ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:38.098676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4c9d-88ff-4b63-8683-b7b47e463ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:38.098985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4c9d-88ff-4b63-8683-b7b47e463ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:38.099259 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4c9d-88ff-4b63-8683-b7b47e463ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:38.099924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa4c9d-88ff-4b63-8683-b7b47e463ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:52:38.100237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa4c9d-88ff-4b63-8683-b7b47e463ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:38.102819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa4c9d-88ff-4b63-8683-b7b47e463ed0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:38.130642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1323/2665] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:52:38.137189 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436713f8-08ea-4122-a39c-5c3ad1297527 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:38.155471 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436713f8-08ea-4122-a39c-5c3ad1297527 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:38.184238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6ee20-08e4-4773-bb92-28217e39ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:38.184888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ee20-08e4-4773-bb92-28217e39ba9d admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:38.185168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ee20-08e4-4773-bb92-28217e39ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:38.185916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ee20-08e4-4773-bb92-28217e39ba9d admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:38.186321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6ee20-08e4-4773-bb92-28217e39ba9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:38.188661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6ee20-08e4-4773-bb92-28217e39ba9d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:38.285304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1343/2666] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:38 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:52:38.289371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa4c9d-88ff-4b63-8683-b7b47e463ed0 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:38.302474 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa4c9d-88ff-4b63-8683-b7b47e463ed0 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:38.463558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589796e8-ef37-4364-9cfb-bf1c7aa418ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:38.464791 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589796e8-ef37-4364-9cfb-bf1c7aa418ee admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:38.465234 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589796e8-ef37-4364-9cfb-bf1c7aa418ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:38.466689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589796e8-ef37-4364-9cfb-bf1c7aa418ee admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:38.468139 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589796e8-ef37-4364-9cfb-bf1c7aa418ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:38.474978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589796e8-ef37-4364-9cfb-bf1c7aa418ee admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:38.550627 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1324/2667] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:38 2022] POST /identity/v3/users => generated 282 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:52:38.556169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6ee20-08e4-4773-bb92-28217e39ba9d admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:38.594354 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6ee20-08e4-4773-bb92-28217e39ba9d admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:38.603989 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aac660-ef16-41bf-a971-8c225b6c162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:38.607779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aac660-ef16-41bf-a971-8c225b6c162c admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:38.608286 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aac660-ef16-41bf-a971-8c225b6c162c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:38.608884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aac660-ef16-41bf-a971-8c225b6c162c admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:38.609779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aac660-ef16-41bf-a971-8c225b6c162c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:38.617904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aac660-ef16-41bf-a971-8c225b6c162c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:38.636843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1344/2668] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:38.641045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589796e8-ef37-4364-9cfb-bf1c7aa418ee admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:38.658339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589796e8-ef37-4364-9cfb-bf1c7aa418ee admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:38.673254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083822-8b85-4d96-a195-838736388d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:38.674391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083822-8b85-4d96-a195-838736388d33 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:38.674674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083822-8b85-4d96-a195-838736388d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:38.674984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083822-8b85-4d96-a195-838736388d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:38.675666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2083822-8b85-4d96-a195-838736388d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:38.677567 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2083822-8b85-4d96-a195-838736388d33 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:38.714671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1325/2669] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:38.724234 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aac660-ef16-41bf-a971-8c225b6c162c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:38.749576 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aac660-ef16-41bf-a971-8c225b6c162c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:38.772693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add68996-2ef9-4684-bf33-48d8796b89f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:38.773600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add68996-2ef9-4684-bf33-48d8796b89f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:38.773888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add68996-2ef9-4684-bf33-48d8796b89f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:38.774169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add68996-2ef9-4684-bf33-48d8796b89f2 admin admin] PATH_INFO: `/v3/projects/ce1e2066cbd048e789876299d7eeb48f/users/eea146388c50494793023c36d7334e84/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:38.817603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add68996-2ef9-4684-bf33-48d8796b89f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1e2066cbd048e789876299d7eeb48f, user_id=eea146388c50494793023c36d7334e84, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:38.821018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add68996-2ef9-4684-bf33-48d8796b89f2 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:38.849727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1345/2670] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:38 2022] PUT /identity/v3/projects/ce1e2066cbd048e789876299d7eeb48f/users/eea146388c50494793023c36d7334e84/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:38.860689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b830e4-cb5a-4136-92e1-0661b77767e8 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:38.860999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b830e4-cb5a-4136-92e1-0661b77767e8 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:38.861243 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b830e4-cb5a-4136-92e1-0661b77767e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:38.921989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-87b830e4-cb5a-4136-92e1-0661b77767e8 None None] MFA Rules not processed for user `eea146388c50494793023c36d7334e84`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:38.923256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-87b830e4-cb5a-4136-92e1-0661b77767e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:39.075862 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1326/2671] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:39.080427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add68996-2ef9-4684-bf33-48d8796b89f2 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:39.144543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:39.220783 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add68996-2ef9-4684-bf33-48d8796b89f2 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:39.249715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d655de-deab-4b4e-b4ad-58dc9e948c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:39.250349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d655de-deab-4b4e-b4ad-58dc9e948c84 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:39.250629 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d655de-deab-4b4e-b4ad-58dc9e948c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:39.250935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d655de-deab-4b4e-b4ad-58dc9e948c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:39.251569 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d655de-deab-4b4e-b4ad-58dc9e948c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:39.253522 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d655de-deab-4b4e-b4ad-58dc9e948c84 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:39.345917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b830e4-cb5a-4136-92e1-0661b77767e8 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:39.356552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1346/2672] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:39 2022] POST /identity/v3/projects => generated 363 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:39.365859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b830e4-cb5a-4136-92e1-0661b77767e8 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:39.469136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:39.562152 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897a60d-24a7-4636-8960-4de1529d00e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:39.562830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897a60d-24a7-4636-8960-4de1529d00e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:39.563115 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897a60d-24a7-4636-8960-4de1529d00e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:39.563385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897a60d-24a7-4636-8960-4de1529d00e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:39.564025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897a60d-24a7-4636-8960-4de1529d00e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:39.566027 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897a60d-24a7-4636-8960-4de1529d00e7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:39.640125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1327/2673] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:39 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:39.644239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d655de-deab-4b4e-b4ad-58dc9e948c84 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:39.660680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d655de-deab-4b4e-b4ad-58dc9e948c84 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:39.676661 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce823-686b-4da3-b7c6-c086e33a5d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:39.677669 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce823-686b-4da3-b7c6-c086e33a5d99 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:39.683492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce823-686b-4da3-b7c6-c086e33a5d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:39.683985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce823-686b-4da3-b7c6-c086e33a5d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:39.691826 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ce823-686b-4da3-b7c6-c086e33a5d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:39.696336 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ce823-686b-4da3-b7c6-c086e33a5d99 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:39.766231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1347/2674] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:52:39.770186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897a60d-24a7-4636-8960-4de1529d00e7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:39.781522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897a60d-24a7-4636-8960-4de1529d00e7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:39.816176 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca937e2-aaf2-4f11-972c-988fe0bc0475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:39.816878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca937e2-aaf2-4f11-972c-988fe0bc0475 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:39.817161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca937e2-aaf2-4f11-972c-988fe0bc0475 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:39.817437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca937e2-aaf2-4f11-972c-988fe0bc0475 admin admin] PATH_INFO: `/v3/projects/0364f35e52fa4ea2b081a2b31cf1ff46/users/2adbae8f07434a66acc07c0efa88dd3b/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:39.868886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca937e2-aaf2-4f11-972c-988fe0bc0475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0364f35e52fa4ea2b081a2b31cf1ff46, user_id=2adbae8f07434a66acc07c0efa88dd3b, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:39.879965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca937e2-aaf2-4f11-972c-988fe0bc0475 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:39.925442 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1328/2675] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:39 2022] PUT /identity/v3/projects/0364f35e52fa4ea2b081a2b31cf1ff46/users/2adbae8f07434a66acc07c0efa88dd3b/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:39.930539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce823-686b-4da3-b7c6-c086e33a5d99 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:39.952068 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce823-686b-4da3-b7c6-c086e33a5d99 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:40.156488 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b13b67-f010-4704-9980-eddd9a4de26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:40.157117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b13b67-f010-4704-9980-eddd9a4de26f admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:40.157394 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b13b67-f010-4704-9980-eddd9a4de26f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:40.157665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b13b67-f010-4704-9980-eddd9a4de26f admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:40.158324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b13b67-f010-4704-9980-eddd9a4de26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:40.160013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b13b67-f010-4704-9980-eddd9a4de26f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:40.189466 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1348/2676] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:40.193515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca937e2-aaf2-4f11-972c-988fe0bc0475 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:40.215215 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca937e2-aaf2-4f11-972c-988fe0bc0475 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:40.233282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61467528-74f3-4444-84e9-237fe41266ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:40.235482 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61467528-74f3-4444-84e9-237fe41266ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:40.236095 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61467528-74f3-4444-84e9-237fe41266ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:40.236606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61467528-74f3-4444-84e9-237fe41266ea admin admin] PATH_INFO: `/v3/projects/0364f35e52fa4ea2b081a2b31cf1ff46/users/2adbae8f07434a66acc07c0efa88dd3b/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:40.240326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61467528-74f3-4444-84e9-237fe41266ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0364f35e52fa4ea2b081a2b31cf1ff46, user_id=2adbae8f07434a66acc07c0efa88dd3b, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:40.248299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61467528-74f3-4444-84e9-237fe41266ea admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:40.324814 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1329/2677] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:40 2022] PUT /identity/v3/projects/0364f35e52fa4ea2b081a2b31cf1ff46/users/2adbae8f07434a66acc07c0efa88dd3b/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:40.336804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b2e72-24d7-403b-afca-38a8b2f0ad19 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:40.337460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b2e72-24d7-403b-afca-38a8b2f0ad19 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:40.337925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b2e72-24d7-403b-afca-38a8b2f0ad19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:40.439350 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-738b2e72-24d7-403b-afca-38a8b2f0ad19 None None] MFA Rules not processed for user `2adbae8f07434a66acc07c0efa88dd3b`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:40.445969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-738b2e72-24d7-403b-afca-38a8b2f0ad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:40.609188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1349/2678] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:40.636784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61467528-74f3-4444-84e9-237fe41266ea admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:40.640011 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-61467528-74f3-4444-84e9-237fe41266ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:40.751560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61467528-74f3-4444-84e9-237fe41266ea admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:40.755855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14439f9e-10da-4230-987a-0f845f2e59a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:40.756776 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14439f9e-10da-4230-987a-0f845f2e59a0 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:40.757240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14439f9e-10da-4230-987a-0f845f2e59a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:40.757774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14439f9e-10da-4230-987a-0f845f2e59a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:40.773598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14439f9e-10da-4230-987a-0f845f2e59a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:40.775811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14439f9e-10da-4230-987a-0f845f2e59a0 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:40.810093 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1330/2679] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:40.965482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b2e72-24d7-403b-afca-38a8b2f0ad19 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:40.983600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b2e72-24d7-403b-afca-38a8b2f0ad19 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:40.995876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21934737-f329-4671-abbe-8eb1cbf2385c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:40.996550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21934737-f329-4671-abbe-8eb1cbf2385c service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:40.996894 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21934737-f329-4671-abbe-8eb1cbf2385c service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:40.997305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21934737-f329-4671-abbe-8eb1cbf2385c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:41.068862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:41.195915 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21934737-f329-4671-abbe-8eb1cbf2385c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:41.198125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21934737-f329-4671-abbe-8eb1cbf2385c service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:41.232474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1350/2680] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:41.312391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0236-5cf3-48a5-a991-aa403bf3dd9c None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:41.313227 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0236-5cf3-48a5-a991-aa403bf3dd9c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:41.314575 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0236-5cf3-48a5-a991-aa403bf3dd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:41.355026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-12bf0236-5cf3-48a5-a991-aa403bf3dd9c None None] MFA Rules not processed for user `c785ec0dbacc4dbb97a5a9f994bc58bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:41.356964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-12bf0236-5cf3-48a5-a991-aa403bf3dd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:41.511754 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1331/2681] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:41.529215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21934737-f329-4671-abbe-8eb1cbf2385c service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:41.530974 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-21934737-f329-4671-abbe-8eb1cbf2385c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:41.662450 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21934737-f329-4671-abbe-8eb1cbf2385c service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:41.674885 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d3660-5dea-43bf-8c02-d66126f55e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:41.676807 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d3660-5dea-43bf-8c02-d66126f55e89 service nova] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:41.677904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d3660-5dea-43bf-8c02-d66126f55e89 service nova] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:41.679377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d3660-5dea-43bf-8c02-d66126f55e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:41.685984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3c0d3660-5dea-43bf-8c02-d66126f55e89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:41.859260 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d3660-5dea-43bf-8c02-d66126f55e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:41.861471 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d3660-5dea-43bf-8c02-d66126f55e89 service nova] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:41.875853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1351/2682] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:52:43.549432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1acaaa-65db-48e0-97b3-ab096b3f44ba None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:43.550000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1acaaa-65db-48e0-97b3-ab096b3f44ba None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:43.550000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1acaaa-65db-48e0-97b3-ab096b3f44ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:43.582387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-2e1acaaa-65db-48e0-97b3-ab096b3f44ba None None] MFA Rules not processed for user `f111f756f37c45e1b575ba2da90311f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:43.582647 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-2e1acaaa-65db-48e0-97b3-ab096b3f44ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:43.598600 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1332/2683] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:44.520412 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d3660-5dea-43bf-8c02-d66126f55e89 service nova] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:44.614000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d3660-5dea-43bf-8c02-d66126f55e89 service nova] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:44.620408 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:44.621132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:44.621434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:44.621704 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] PATH_INFO: `/v3/users/eea146388c50494793023c36d7334e84` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:44.623831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea146388c50494793023c36d7334e84)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:44.626018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:44.634841 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:44.748626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea146388c50494793023c36d7334e84'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:44.749012 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea146388c50494793023c36d7334e84'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:44.749750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea146388c50494793023c36d7334e84'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:44.767738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea146388c50494793023c36d7334e84'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:44.784861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea146388c50494793023c36d7334e84'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:44.821861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1352/2684] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:44 2022] DELETE /identity/v3/users/eea146388c50494793023c36d7334e84 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:44.827511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e686a-2a2d-4992-8b4c-48a69d90d016 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:44.828990 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e686a-2a2d-4992-8b4c-48a69d90d016 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:44.829441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e686a-2a2d-4992-8b4c-48a69d90d016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:44.851790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-3f7e686a-2a2d-4992-8b4c-48a69d90d016 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:44.853358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3f7e686a-2a2d-4992-8b4c-48a69d90d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:44.861174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:44.941330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1333/2685] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:44.945165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:44.948277 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:45.047845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b248f-1662-4e84-939a-dde4c50b858e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:45.052453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c16f52-ba37-456b-92e6-05deadeed7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:45.053949 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c16f52-ba37-456b-92e6-05deadeed7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:45.054322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c16f52-ba37-456b-92e6-05deadeed7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:45.054600 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c16f52-ba37-456b-92e6-05deadeed7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:45.068007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c16f52-ba37-456b-92e6-05deadeed7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:45.070647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c16f52-ba37-456b-92e6-05deadeed7b8 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:45.083833 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1353/2686] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:45.544763 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e686a-2a2d-4992-8b4c-48a69d90d016 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:45.546282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3f7e686a-2a2d-4992-8b4c-48a69d90d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:45.590736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e686a-2a2d-4992-8b4c-48a69d90d016 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:45.603335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:45.605707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:45.606423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:45.607494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] PATH_INFO: `/v3/projects/ce1e2066cbd048e789876299d7eeb48f` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:45.609772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1e2066cbd048e789876299d7eeb48f)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:45.613290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:45.707092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1e2066cbd048e789876299d7eeb48f', 'request_id': 'req-bee2aa92-632d-4a9a-95ac-753f7c5914a3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:45.721193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1e2066cbd048e789876299d7eeb48f', 'request_id': 'req-bee2aa92-632d-4a9a-95ac-753f7c5914a3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:45.733996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1e2066cbd048e789876299d7eeb48f', 'request_id': 'req-bee2aa92-632d-4a9a-95ac-753f7c5914a3'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:45.757558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] The token cache is being invalidate because project ce1e2066cbd048e789876299d7eeb48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:45.757952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:45.759021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:45.762249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1334/2687] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:45 2022] DELETE /identity/v3/projects/ce1e2066cbd048e789876299d7eeb48f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:45.776072 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c16f52-ba37-456b-92e6-05deadeed7b8 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:45.788654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c16f52-ba37-456b-92e6-05deadeed7b8 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:45.921493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:45.922389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:45.922854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:45.923297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] PATH_INFO: `/v3/users/2adbae8f07434a66acc07c0efa88dd3b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:45.925921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2adbae8f07434a66acc07c0efa88dd3b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:45.933891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:45.996519 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:46.042904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2adbae8f07434a66acc07c0efa88dd3b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.043886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2adbae8f07434a66acc07c0efa88dd3b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.044607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2adbae8f07434a66acc07c0efa88dd3b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.079539 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2adbae8f07434a66acc07c0efa88dd3b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.090067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7c1e8929-c5c7-4e37-b5f0-13510acaa618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2adbae8f07434a66acc07c0efa88dd3b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.118737 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1354/2688] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:45 2022] DELETE /identity/v3/users/2adbae8f07434a66acc07c0efa88dd3b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:46.544679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:46.546471 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:46.589901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2aa92-632d-4a9a-95ac-753f7c5914a3 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:46.715606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:46.716331 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:46.716682 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:46.717054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] PATH_INFO: `/v3/projects/0364f35e52fa4ea2b081a2b31cf1ff46` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:46.718288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0364f35e52fa4ea2b081a2b31cf1ff46)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:46.720384 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:46.777880 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:46.793667 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0364f35e52fa4ea2b081a2b31cf1ff46', 'request_id': 'req-e3e87b6b-759d-4384-b60b-565b4789d10d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.805153 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0364f35e52fa4ea2b081a2b31cf1ff46', 'request_id': 'req-e3e87b6b-759d-4384-b60b-565b4789d10d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.813552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0364f35e52fa4ea2b081a2b31cf1ff46', 'request_id': 'req-e3e87b6b-759d-4384-b60b-565b4789d10d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.837571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] The token cache is being invalidate because project 0364f35e52fa4ea2b081a2b31cf1ff46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:52:46.837854 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.838544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e3e87b6b-759d-4384-b60b-565b4789d10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:52:46.840341 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1335/2689] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:52:46 2022] DELETE /identity/v3/projects/0364f35e52fa4ea2b081a2b31cf1ff46 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:46.845237 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a5a33-9366-4cdc-a3df-c17f21c1307a None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:46.845869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a5a33-9366-4cdc-a3df-c17f21c1307a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:46.845869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a5a33-9366-4cdc-a3df-c17f21c1307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:46.870599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-129a5a33-9366-4cdc-a3df-c17f21c1307a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:46.872042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-129a5a33-9366-4cdc-a3df-c17f21c1307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:46.995813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1355/2690] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:47.004615 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad9df7-1d51-453e-8a38-9a161d23d9d7 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.004904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad9df7-1d51-453e-8a38-9a161d23d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.005183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad9df7-1d51-453e-8a38-9a161d23d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.034480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-41ad9df7-1d51-453e-8a38-9a161d23d9d7 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:47.035792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-41ad9df7-1d51-453e-8a38-9a161d23d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:47.045901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1336/2691] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:47.051138 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a5a33-9366-4cdc-a3df-c17f21c1307a None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.067581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a5a33-9366-4cdc-a3df-c17f21c1307a None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.075954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150620a3-6ff7-4c15-b945-35bf53fe95c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.076830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150620a3-6ff7-4c15-b945-35bf53fe95c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.077177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150620a3-6ff7-4c15-b945-35bf53fe95c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.077647 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150620a3-6ff7-4c15-b945-35bf53fe95c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.078405 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150620a3-6ff7-4c15-b945-35bf53fe95c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:52:47.079067 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150620a3-6ff7-4c15-b945-35bf53fe95c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:47.080932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150620a3-6ff7-4c15-b945-35bf53fe95c3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:47.114823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1356/2692] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:52:47.118394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad9df7-1d51-453e-8a38-9a161d23d9d7 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.129308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad9df7-1d51-453e-8a38-9a161d23d9d7 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.134795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fee4bb-1b85-455c-b1ab-7d9ea9f7a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.135422 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fee4bb-1b85-455c-b1ab-7d9ea9f7a9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.135840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fee4bb-1b85-455c-b1ab-7d9ea9f7a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.136118 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fee4bb-1b85-455c-b1ab-7d9ea9f7a9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.136767 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fee4bb-1b85-455c-b1ab-7d9ea9f7a9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:47.138707 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fee4bb-1b85-455c-b1ab-7d9ea9f7a9e7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:47.201430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1337/2693] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:47 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:52:47.205692 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150620a3-6ff7-4c15-b945-35bf53fe95c3 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.218921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150620a3-6ff7-4c15-b945-35bf53fe95c3 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.291789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd3a02-9a30-487c-b152-0c80c98972ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.292721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd3a02-9a30-487c-b152-0c80c98972ec admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.293101 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd3a02-9a30-487c-b152-0c80c98972ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.293472 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd3a02-9a30-487c-b152-0c80c98972ec admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.294238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd3a02-9a30-487c-b152-0c80c98972ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:47.296293 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd3a02-9a30-487c-b152-0c80c98972ec admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:47.324501 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1357/2694] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:47 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:52:47.325391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fee4bb-1b85-455c-b1ab-7d9ea9f7a9e7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.337964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fee4bb-1b85-455c-b1ab-7d9ea9f7a9e7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.344875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6e3f1-1046-4a77-8c80-38a1dfc7c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.345558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6e3f1-1046-4a77-8c80-38a1dfc7c90e admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.346064 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6e3f1-1046-4a77-8c80-38a1dfc7c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.346391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6e3f1-1046-4a77-8c80-38a1dfc7c90e admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.347065 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6e3f1-1046-4a77-8c80-38a1dfc7c90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:47.349412 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6e3f1-1046-4a77-8c80-38a1dfc7c90e admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:47.363004 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1338/2695] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:47.367599 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd3a02-9a30-487c-b152-0c80c98972ec admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.377805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd3a02-9a30-487c-b152-0c80c98972ec admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.382525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b27cc4-32c8-48f4-8425-22d9667367a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.383132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b27cc4-32c8-48f4-8425-22d9667367a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.383417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b27cc4-32c8-48f4-8425-22d9667367a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.383692 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b27cc4-32c8-48f4-8425-22d9667367a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.384332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b27cc4-32c8-48f4-8425-22d9667367a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:47.386041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b27cc4-32c8-48f4-8425-22d9667367a5 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:47.398490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1358/2696] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:47.402888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6e3f1-1046-4a77-8c80-38a1dfc7c90e admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.419524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6e3f1-1046-4a77-8c80-38a1dfc7c90e admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.426060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7c47a-4559-4239-b2bc-596d42f9fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.426820 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7c47a-4559-4239-b2bc-596d42f9fdd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.427126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7c47a-4559-4239-b2bc-596d42f9fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.427411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7c47a-4559-4239-b2bc-596d42f9fdd2 admin admin] PATH_INFO: `/v3/projects/5a41d5d805824dce90abec6f354b730f/users/dcdc87aee63c4080961a26557f14a653/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.446437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7c47a-4559-4239-b2bc-596d42f9fdd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a41d5d805824dce90abec6f354b730f, user_id=dcdc87aee63c4080961a26557f14a653, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:47.449428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7c47a-4559-4239-b2bc-596d42f9fdd2 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:47.470038 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1339/2697] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:47 2022] PUT /identity/v3/projects/5a41d5d805824dce90abec6f354b730f/users/dcdc87aee63c4080961a26557f14a653/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:47.482192 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09548be6-3214-4665-bd8a-f33666d06dda None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.482628 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09548be6-3214-4665-bd8a-f33666d06dda None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.483037 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09548be6-3214-4665-bd8a-f33666d06dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.511876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:47.526840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-09548be6-3214-4665-bd8a-f33666d06dda None None] MFA Rules not processed for user `dcdc87aee63c4080961a26557f14a653`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:47.528490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-09548be6-3214-4665-bd8a-f33666d06dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:47.644763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1359/2698] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:47.649668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7c47a-4559-4239-b2bc-596d42f9fdd2 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.719601 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7c47a-4559-4239-b2bc-596d42f9fdd2 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.728020 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57126d4-efeb-4eff-93c7-5b22d1ff8f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.729551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57126d4-efeb-4eff-93c7-5b22d1ff8f85 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.729877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57126d4-efeb-4eff-93c7-5b22d1ff8f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.730354 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57126d4-efeb-4eff-93c7-5b22d1ff8f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.731886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57126d4-efeb-4eff-93c7-5b22d1ff8f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:47.736697 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57126d4-efeb-4eff-93c7-5b22d1ff8f85 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:47.784312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1340/2699] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:52:47 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:52:47.789616 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09548be6-3214-4665-bd8a-f33666d06dda None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.804652 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09548be6-3214-4665-bd8a-f33666d06dda None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.889055 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8c5d7-c15e-49f3-8843-29999450b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.890109 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8c5d7-c15e-49f3-8843-29999450b5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.890516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8c5d7-c15e-49f3-8843-29999450b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.890954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8c5d7-c15e-49f3-8843-29999450b5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.891714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8c5d7-c15e-49f3-8843-29999450b5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:47.893890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8c5d7-c15e-49f3-8843-29999450b5c5 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:47.922805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1360/2700] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:52:47 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:52:47.926468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57126d4-efeb-4eff-93c7-5b22d1ff8f85 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.943925 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57126d4-efeb-4eff-93c7-5b22d1ff8f85 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.949008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f067c6d-aca0-4a09-98d8-76c99a73b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.949812 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f067c6d-aca0-4a09-98d8-76c99a73b69a admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.950096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f067c6d-aca0-4a09-98d8-76c99a73b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.950366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f067c6d-aca0-4a09-98d8-76c99a73b69a admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:47.951034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f067c6d-aca0-4a09-98d8-76c99a73b69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:47.952638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f067c6d-aca0-4a09-98d8-76c99a73b69a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:47.966247 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1341/2701] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:52:47.970889 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8c5d7-c15e-49f3-8843-29999450b5c5 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:47.985314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8c5d7-c15e-49f3-8843-29999450b5c5 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:47.991304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea069c-c7bb-4747-a03f-4520b22960f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:47.992070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea069c-c7bb-4747-a03f-4520b22960f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:47.992348 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea069c-c7bb-4747-a03f-4520b22960f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:47.992621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea069c-c7bb-4747-a03f-4520b22960f8 admin admin] PATH_INFO: `/v3/projects/53a1097e2e754d45b988817e57e0c5a8/users/8ad14ef1e1f4434299601871b1d43d54/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:48.013654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea069c-c7bb-4747-a03f-4520b22960f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a1097e2e754d45b988817e57e0c5a8, user_id=8ad14ef1e1f4434299601871b1d43d54, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:48.017098 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea069c-c7bb-4747-a03f-4520b22960f8 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:48.035239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1361/2702] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:47 2022] PUT /identity/v3/projects/53a1097e2e754d45b988817e57e0c5a8/users/8ad14ef1e1f4434299601871b1d43d54/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:48.040396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f067c6d-aca0-4a09-98d8-76c99a73b69a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:48.055135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f067c6d-aca0-4a09-98d8-76c99a73b69a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:48.105107 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:48.157249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9acd9b-510a-4218-83e3-7a4bb10fde4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:48.158282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9acd9b-510a-4218-83e3-7a4bb10fde4c admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:48.159274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9acd9b-510a-4218-83e3-7a4bb10fde4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:48.159797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9acd9b-510a-4218-83e3-7a4bb10fde4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:48.160819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9acd9b-510a-4218-83e3-7a4bb10fde4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:48.166214 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9acd9b-510a-4218-83e3-7a4bb10fde4c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:48.186435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1342/2703] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:52:48.187961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea069c-c7bb-4747-a03f-4520b22960f8 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:48.207103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea069c-c7bb-4747-a03f-4520b22960f8 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:48.213310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1bf72-c5b2-4014-9236-545cfe66508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:48.214063 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1bf72-c5b2-4014-9236-545cfe66508e admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:48.214382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1bf72-c5b2-4014-9236-545cfe66508e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:48.214691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1bf72-c5b2-4014-9236-545cfe66508e admin admin] PATH_INFO: `/v3/projects/53a1097e2e754d45b988817e57e0c5a8/users/8ad14ef1e1f4434299601871b1d43d54/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:48.216727 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1bf72-c5b2-4014-9236-545cfe66508e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a1097e2e754d45b988817e57e0c5a8, user_id=8ad14ef1e1f4434299601871b1d43d54, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:48.220099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1bf72-c5b2-4014-9236-545cfe66508e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:48.237177 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1362/2704] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:52:48 2022] PUT /identity/v3/projects/53a1097e2e754d45b988817e57e0c5a8/users/8ad14ef1e1f4434299601871b1d43d54/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:52:48.258956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4bc7c-ba9b-4526-b297-4529475917e7 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:48.259392 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4bc7c-ba9b-4526-b297-4529475917e7 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:48.259587 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4bc7c-ba9b-4526-b297-4529475917e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:48.295420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-73e4bc7c-ba9b-4526-b297-4529475917e7 None None] MFA Rules not processed for user `8ad14ef1e1f4434299601871b1d43d54`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:52:48.297194 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-73e4bc7c-ba9b-4526-b297-4529475917e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:48.391823 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1343/2705] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:52:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:52:48.403642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1bf72-c5b2-4014-9236-545cfe66508e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:48.405383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-10f1bf72-c5b2-4014-9236-545cfe66508e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:48.485740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1bf72-c5b2-4014-9236-545cfe66508e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:48.490062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85687-fee2-4abc-9733-33c23077d68f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:48.491409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85687-fee2-4abc-9733-33c23077d68f service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:48.491714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85687-fee2-4abc-9733-33c23077d68f service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:48.491975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85687-fee2-4abc-9733-33c23077d68f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:48.497795 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:48.562428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d85687-fee2-4abc-9733-33c23077d68f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:48.563975 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d85687-fee2-4abc-9733-33c23077d68f service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:48.574504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1363/2706] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:52:51.367017 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4bc7c-ba9b-4526-b297-4529475917e7 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:51.377528 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4bc7c-ba9b-4526-b297-4529475917e7 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:52:51.381772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac94d65-b732-445b-a5a3-a95b756ef29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:52:51.382423 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac94d65-b732-445b-a5a3-a95b756ef29a service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:52:51.382713 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac94d65-b732-445b-a5a3-a95b756ef29a service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:52:51.383018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac94d65-b732-445b-a5a3-a95b756ef29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:52:51.395635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac94d65-b732-445b-a5a3-a95b756ef29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:52:51.397764 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac94d65-b732-445b-a5a3-a95b756ef29a service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:52:51.413047 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1344/2707] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:52:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:52:58.570499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=24 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:59.907543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85687-fee2-4abc-9733-33c23077d68f service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:52:59.909145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e0d85687-fee2-4abc-9733-33c23077d68f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:52:59.998559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85687-fee2-4abc-9733-33c23077d68f service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:00.004276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:00.004848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:00.005125 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:00.005425 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] PATH_INFO: `/v3/users/f2885719bd1343a685cac4c7b22c9ccd` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:00.007204 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2885719bd1343a685cac4c7b22c9ccd)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:00.009253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:00.061122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2885719bd1343a685cac4c7b22c9ccd'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.061796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2885719bd1343a685cac4c7b22c9ccd'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.062400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2885719bd1343a685cac4c7b22c9ccd'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.070082 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2885719bd1343a685cac4c7b22c9ccd'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.077487 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2885719bd1343a685cac4c7b22c9ccd'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.096338 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1364/2708] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:52:59 2022] DELETE /identity/v3/users/f2885719bd1343a685cac4c7b22c9ccd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:00.101430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512215-1c84-40e8-af8d-692571557f53 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:00.102028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512215-1c84-40e8-af8d-692571557f53 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:00.102028 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512215-1c84-40e8-af8d-692571557f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:00.121560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4c512215-1c84-40e8-af8d-692571557f53 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:00.122761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4c512215-1c84-40e8-af8d-692571557f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:00.184987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1345/2709] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:00.195682 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:00.197106 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:00.260091 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd653-679b-426f-95cd-9b73c498aac1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:00.263845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391a2f-63dc-45a7-8c0e-025f44256af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:00.264745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391a2f-63dc-45a7-8c0e-025f44256af2 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:00.265028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391a2f-63dc-45a7-8c0e-025f44256af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:00.265305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391a2f-63dc-45a7-8c0e-025f44256af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:00.275749 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391a2f-63dc-45a7-8c0e-025f44256af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:00.277192 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391a2f-63dc-45a7-8c0e-025f44256af2 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:00.287413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1365/2710] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:00.579920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512215-1c84-40e8-af8d-692571557f53 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:00.584782 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4c512215-1c84-40e8-af8d-692571557f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:00.597340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512215-1c84-40e8-af8d-692571557f53 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:00.603055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:00.603715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:00.603989 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:00.604269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] PATH_INFO: `/v3/projects/b07d55e1442b4cf49384b91993c4f928` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:00.605768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07d55e1442b4cf49384b91993c4f928)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:00.608794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:00.665904 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:00.675030 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07d55e1442b4cf49384b91993c4f928', 'request_id': 'req-02ad3b7a-359f-4d4f-ba05-69965b8af708'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.685803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07d55e1442b4cf49384b91993c4f928', 'request_id': 'req-02ad3b7a-359f-4d4f-ba05-69965b8af708'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.692303 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07d55e1442b4cf49384b91993c4f928', 'request_id': 'req-02ad3b7a-359f-4d4f-ba05-69965b8af708'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.710260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] The token cache is being invalidate because project b07d55e1442b4cf49384b91993c4f928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:00.710588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.711302 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-02ad3b7a-359f-4d4f-ba05-69965b8af708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:00.712840 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1346/2711] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:00 2022] DELETE /identity/v3/projects/b07d55e1442b4cf49384b91993c4f928 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:00.717957 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43a90a-c422-4546-974c-d5e4d32e2f5a None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:00.718250 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43a90a-c422-4546-974c-d5e4d32e2f5a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:00.718530 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43a90a-c422-4546-974c-d5e4d32e2f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:00.741638 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-4d43a90a-c422-4546-974c-d5e4d32e2f5a None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:00.743018 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-4d43a90a-c422-4546-974c-d5e4d32e2f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:00.762683 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:00.832325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1366/2712] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:00.841169 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049b5e4-6068-41f8-8e6d-754bf344efe2 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:00.841473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049b5e4-6068-41f8-8e6d-754bf344efe2 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:00.841739 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049b5e4-6068-41f8-8e6d-754bf344efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:00.873189 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c049b5e4-6068-41f8-8e6d-754bf344efe2 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:00.874443 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c049b5e4-6068-41f8-8e6d-754bf344efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:00.884037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1347/2713] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:00.889736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43a90a-c422-4546-974c-d5e4d32e2f5a None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:00.902284 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43a90a-c422-4546-974c-d5e4d32e2f5a None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:00.907698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3347b-5c28-4547-b1fa-f4526d5216ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:00.908625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3347b-5c28-4547-b1fa-f4526d5216ff admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:00.908625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3347b-5c28-4547-b1fa-f4526d5216ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:00.908921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3347b-5c28-4547-b1fa-f4526d5216ff admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:00.909538 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3347b-5c28-4547-b1fa-f4526d5216ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:53:00.909943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3347b-5c28-4547-b1fa-f4526d5216ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:00.911820 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3347b-5c28-4547-b1fa-f4526d5216ff admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:00.912062 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79ca3b-e214-4374-a86b-b7be1d94f86d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:00.912555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79ca3b-e214-4374-a86b-b7be1d94f86d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:00.912906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79ca3b-e214-4374-a86b-b7be1d94f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:00.924416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1367/2714] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:53:00.929817 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3347b-5c28-4547-b1fa-f4526d5216ff admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:00.940286 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-5e79ca3b-e214-4374-a86b-b7be1d94f86d None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:00.941572 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5e79ca3b-e214-4374-a86b-b7be1d94f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:00.942631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3347b-5c28-4547-b1fa-f4526d5216ff admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:00.949002 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd6600-dc31-4fab-bdfc-8c7c1d575037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:00.949617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd6600-dc31-4fab-bdfc-8c7c1d575037 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:00.949893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd6600-dc31-4fab-bdfc-8c7c1d575037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:00.950168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd6600-dc31-4fab-bdfc-8c7c1d575037 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:00.950836 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd6600-dc31-4fab-bdfc-8c7c1d575037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:00.952747 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd6600-dc31-4fab-bdfc-8c7c1d575037 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:00.985883 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1368/2715] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:00 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:00.990950 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd6600-dc31-4fab-bdfc-8c7c1d575037 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:01.011803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1348/2716] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 11:53:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:01.027576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79ca3b-e214-4374-a86b-b7be1d94f86d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:01.029613 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-5e79ca3b-e214-4374-a86b-b7be1d94f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:01.076478 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd6600-dc31-4fab-bdfc-8c7c1d575037 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:01.085959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3329f1-ca70-4b95-8271-93accf1a5c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:01.086247 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3329f1-ca70-4b95-8271-93accf1a5c36 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:01.086448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3329f1-ca70-4b95-8271-93accf1a5c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:01.086816 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3329f1-ca70-4b95-8271-93accf1a5c36 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:01.087473 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3329f1-ca70-4b95-8271-93accf1a5c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:01.089543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3329f1-ca70-4b95-8271-93accf1a5c36 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:01.114490 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1369/2717] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:00 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:53:01.120749 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79ca3b-e214-4374-a86b-b7be1d94f86d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:01.121986 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3329f1-ca70-4b95-8271-93accf1a5c36 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:01.133180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3329f1-ca70-4b95-8271-93accf1a5c36 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:01.138132 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcb872-1228-41cd-8511-ab9c84a5cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:01.138785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcb872-1228-41cd-8511-ab9c84a5cb6f admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:01.139092 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcb872-1228-41cd-8511-ab9c84a5cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:01.139655 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcb872-1228-41cd-8511-ab9c84a5cb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:01.140468 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcb872-1228-41cd-8511-ab9c84a5cb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:01.142238 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcb872-1228-41cd-8511-ab9c84a5cb6f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:01.153779 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1370/2718] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:01.157934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcb872-1228-41cd-8511-ab9c84a5cb6f admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:01.168475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcb872-1228-41cd-8511-ab9c84a5cb6f admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:01.173740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dc45c-d421-48b4-b027-81b37a0f086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:01.174485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dc45c-d421-48b4-b027-81b37a0f086b admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:01.174786 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dc45c-d421-48b4-b027-81b37a0f086b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:01.175066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dc45c-d421-48b4-b027-81b37a0f086b admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:01.175714 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dc45c-d421-48b4-b027-81b37a0f086b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:01.177376 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dc45c-d421-48b4-b027-81b37a0f086b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:01.190510 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1371/2719] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:53:01.194339 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91fe7-2cd7-4c84-8758-36a9dff79f8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:01.195221 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91fe7-2cd7-4c84-8758-36a9dff79f8c service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:01.195460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dc45c-d421-48b4-b027-81b37a0f086b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:01.195860 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91fe7-2cd7-4c84-8758-36a9dff79f8c service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:01.196137 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91fe7-2cd7-4c84-8758-36a9dff79f8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:01.205606 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dc45c-d421-48b4-b027-81b37a0f086b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:01.205781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:01.211728 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f5238-f64d-41b0-b6e4-752f605d191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:01.212373 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f5238-f64d-41b0-b6e4-752f605d191a admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:01.212658 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f5238-f64d-41b0-b6e4-752f605d191a admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:01.212932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f5238-f64d-41b0-b6e4-752f605d191a admin admin] PATH_INFO: `/v3/projects/1aaa42b0a36547b49618934ac6fd41b0/users/d48b170f1d80418180d49f615ff11438/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:01.230904 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f5238-f64d-41b0-b6e4-752f605d191a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aaa42b0a36547b49618934ac6fd41b0, user_id=d48b170f1d80418180d49f615ff11438, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:01.233726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f5238-f64d-41b0-b6e4-752f605d191a admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:01.250423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1372/2720] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:01 2022] PUT /identity/v3/projects/1aaa42b0a36547b49618934ac6fd41b0/users/d48b170f1d80418180d49f615ff11438/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:01.261968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc9791-0521-4c98-967b-5e269cb5769f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:01.262285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc9791-0521-4c98-967b-5e269cb5769f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:01.262499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc9791-0521-4c98-967b-5e269cb5769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:01.269511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91fe7-2cd7-4c84-8758-36a9dff79f8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:01.271556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91fe7-2cd7-4c84-8758-36a9dff79f8c service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:01.280652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1349/2721] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:53:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:53:01.292197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6fdc9791-0521-4c98-967b-5e269cb5769f None None] MFA Rules not processed for user `d48b170f1d80418180d49f615ff11438`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:01.293608 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6fdc9791-0521-4c98-967b-5e269cb5769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:01.318947 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:01.372561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1373/2722] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:01.384235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91fe7-2cd7-4c84-8758-36a9dff79f8c service swift] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:01.385895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b0e91fe7-2cd7-4c84-8758-36a9dff79f8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:01.452522 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91fe7-2cd7-4c84-8758-36a9dff79f8c service swift] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:01.515881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6f402-da4a-4a46-bd5d-4ebb15933d97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:01.516514 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6f402-da4a-4a46-bd5d-4ebb15933d97 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:01.516796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6f402-da4a-4a46-bd5d-4ebb15933d97 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:01.517071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6f402-da4a-4a46-bd5d-4ebb15933d97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:01.527504 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6f402-da4a-4a46-bd5d-4ebb15933d97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:01.529481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6f402-da4a-4a46-bd5d-4ebb15933d97 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:01.540908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1350/2723] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:03.315483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc9791-0521-4c98-967b-5e269cb5769f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:03.318404 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6fdc9791-0521-4c98-967b-5e269cb5769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:03.434289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc9791-0521-4c98-967b-5e269cb5769f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:03.439122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:03.439765 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:03.440048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:03.440325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] PATH_INFO: `/v3/users/06fd5308ebe14990b5a146a91c9a380b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:03.441601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fd5308ebe14990b5a146a91c9a380b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:03.444325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:03.501254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fd5308ebe14990b5a146a91c9a380b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.502007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fd5308ebe14990b5a146a91c9a380b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.502619 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fd5308ebe14990b5a146a91c9a380b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.511445 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fd5308ebe14990b5a146a91c9a380b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.520721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-99aeb79d-bddc-4e95-ba41-8e7e131affb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fd5308ebe14990b5a146a91c9a380b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.541251 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1374/2724] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:03 2022] DELETE /identity/v3/users/06fd5308ebe14990b5a146a91c9a380b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:03.720961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6f402-da4a-4a46-bd5d-4ebb15933d97 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:03.732861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6f402-da4a-4a46-bd5d-4ebb15933d97 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:03.794405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:03.795091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:03.795375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:03.795650 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] PATH_INFO: `/v3/projects/0f4b11c231f54fd8beb1e6c2e8b05a03` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:03.796787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4b11c231f54fd8beb1e6c2e8b05a03)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:03.798700 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:03.810292 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:03.850184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4b11c231f54fd8beb1e6c2e8b05a03', 'request_id': 'req-a5839058-2bfd-4f32-a61c-4bb741a692a0'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.858566 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4b11c231f54fd8beb1e6c2e8b05a03', 'request_id': 'req-a5839058-2bfd-4f32-a61c-4bb741a692a0'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.866347 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4b11c231f54fd8beb1e6c2e8b05a03', 'request_id': 'req-a5839058-2bfd-4f32-a61c-4bb741a692a0'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.878906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] The token cache is being invalidate because project 0f4b11c231f54fd8beb1e6c2e8b05a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:03.879201 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.879859 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a5839058-2bfd-4f32-a61c-4bb741a692a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:03.882000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1351/2725] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:03 2022] DELETE /identity/v3/projects/0f4b11c231f54fd8beb1e6c2e8b05a03 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:03.887932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ad26-cf5a-4999-9f6d-ffa470490a75 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:03.888229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ad26-cf5a-4999-9f6d-ffa470490a75 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:03.888507 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ad26-cf5a-4999-9f6d-ffa470490a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:03.908365 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-e519ad26-cf5a-4999-9f6d-ffa470490a75 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:03.909578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e519ad26-cf5a-4999-9f6d-ffa470490a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:03.945786 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:03.973278 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1375/2726] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:03.981375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f92f-0ed8-4876-b063-278a060d4735 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:03.981710 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f92f-0ed8-4876-b063-278a060d4735 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:03.982012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f92f-0ed8-4876-b063-278a060d4735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.003671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-c163f92f-0ed8-4876-b063-278a060d4735 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:04.004964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c163f92f-0ed8-4876-b063-278a060d4735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:04.013519 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1352/2727] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:04.018057 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519ad26-cf5a-4999-9f6d-ffa470490a75 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.027670 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519ad26-cf5a-4999-9f6d-ffa470490a75 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.032221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780789d-dae7-46c6-86a5-553e480d78f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.032825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780789d-dae7-46c6-86a5-553e480d78f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.033103 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780789d-dae7-46c6-86a5-553e480d78f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.033374 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780789d-dae7-46c6-86a5-553e480d78f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.034010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780789d-dae7-46c6-86a5-553e480d78f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:53:04.034311 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780789d-dae7-46c6-86a5-553e480d78f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:04.035943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780789d-dae7-46c6-86a5-553e480d78f1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:04.048809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1376/2728] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:53:04.053983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f92f-0ed8-4876-b063-278a060d4735 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.063156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f92f-0ed8-4876-b063-278a060d4735 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.067797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db3156-7565-442d-9b9a-8dbc4c12dcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.068453 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db3156-7565-442d-9b9a-8dbc4c12dcbf admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.068735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db3156-7565-442d-9b9a-8dbc4c12dcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.069008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db3156-7565-442d-9b9a-8dbc4c12dcbf admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.069626 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db3156-7565-442d-9b9a-8dbc4c12dcbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:04.071546 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db3156-7565-442d-9b9a-8dbc4c12dcbf admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:04.098481 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1353/2729] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:04 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:04.103640 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780789d-dae7-46c6-86a5-553e480d78f1 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.113757 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780789d-dae7-46c6-86a5-553e480d78f1 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.173637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3234f97-621a-457b-a101-d82a78572f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.174244 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3234f97-621a-457b-a101-d82a78572f62 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.174526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3234f97-621a-457b-a101-d82a78572f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.174868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3234f97-621a-457b-a101-d82a78572f62 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.175460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3234f97-621a-457b-a101-d82a78572f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:04.178131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3234f97-621a-457b-a101-d82a78572f62 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:04.201753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1377/2730] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:04 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:04.203937 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db3156-7565-442d-9b9a-8dbc4c12dcbf admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.214541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db3156-7565-442d-9b9a-8dbc4c12dcbf admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.219269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9112089-f33a-4e17-a18c-2550b413c263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.219875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9112089-f33a-4e17-a18c-2550b413c263 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.220162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9112089-f33a-4e17-a18c-2550b413c263 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.220437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9112089-f33a-4e17-a18c-2550b413c263 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.221081 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9112089-f33a-4e17-a18c-2550b413c263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:04.222666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9112089-f33a-4e17-a18c-2550b413c263 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:04.233795 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1354/2731] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:04.237860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3234f97-621a-457b-a101-d82a78572f62 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.248609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3234f97-621a-457b-a101-d82a78572f62 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.253331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4ce12-9992-42a8-beb0-6513870d6666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.253993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4ce12-9992-42a8-beb0-6513870d6666 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.254223 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4ce12-9992-42a8-beb0-6513870d6666 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.254499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4ce12-9992-42a8-beb0-6513870d6666 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.256233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4ce12-9992-42a8-beb0-6513870d6666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:04.257935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4ce12-9992-42a8-beb0-6513870d6666 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:04.269662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1378/2732] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:53:04.273995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9112089-f33a-4e17-a18c-2550b413c263 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.284067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9112089-f33a-4e17-a18c-2550b413c263 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.289550 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74572cc-dd02-40dd-af59-996863a3748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.290206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74572cc-dd02-40dd-af59-996863a3748a admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.290490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74572cc-dd02-40dd-af59-996863a3748a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.290787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74572cc-dd02-40dd-af59-996863a3748a admin admin] PATH_INFO: `/v3/projects/1b32316136164d55801562ef63fe09f4/users/f6ee258a4324453d852ec8a471a92279/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.305963 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74572cc-dd02-40dd-af59-996863a3748a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b32316136164d55801562ef63fe09f4, user_id=f6ee258a4324453d852ec8a471a92279, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:04.308659 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74572cc-dd02-40dd-af59-996863a3748a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:04.322799 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1355/2733] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:04 2022] PUT /identity/v3/projects/1b32316136164d55801562ef63fe09f4/users/f6ee258a4324453d852ec8a471a92279/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:04.334159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3180f-0a60-42c9-a8ca-b87c5323abfc None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.334691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3180f-0a60-42c9-a8ca-b87c5323abfc None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.334691 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3180f-0a60-42c9-a8ca-b87c5323abfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.362843 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-68f3180f-0a60-42c9-a8ca-b87c5323abfc None None] MFA Rules not processed for user `f6ee258a4324453d852ec8a471a92279`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:04.364052 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-68f3180f-0a60-42c9-a8ca-b87c5323abfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:04.432810 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1379/2734] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:04.444980 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74572cc-dd02-40dd-af59-996863a3748a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.446785 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b74572cc-dd02-40dd-af59-996863a3748a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:04.512863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74572cc-dd02-40dd-af59-996863a3748a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.516770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8421fd-55ab-42ce-acc4-df921964e0ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.517385 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8421fd-55ab-42ce-acc4-df921964e0ec service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.517673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8421fd-55ab-42ce-acc4-df921964e0ec service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.517951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8421fd-55ab-42ce-acc4-df921964e0ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.528291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8421fd-55ab-42ce-acc4-df921964e0ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:04.529719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8421fd-55ab-42ce-acc4-df921964e0ec service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:04.540457 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1356/2735] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:04.566302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3180f-0a60-42c9-a8ca-b87c5323abfc None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.585147 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8421fd-55ab-42ce-acc4-df921964e0ec service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.586552 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bb8421fd-55ab-42ce-acc4-df921964e0ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:04.612922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:04.635216 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:04.645263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3180f-0a60-42c9-a8ca-b87c5323abfc None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.651581 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.652358 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.652645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.652911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] PATH_INFO: `/v3/users/f6ee258a4324453d852ec8a471a92279` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.654107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ee258a4324453d852ec8a471a92279)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:04.656107 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:04.668923 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8421fd-55ab-42ce-acc4-df921964e0ec service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.675183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.676618 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.676956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.677529 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] PATH_INFO: `/v3/users/dcdc87aee63c4080961a26557f14a653` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.679175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcdc87aee63c4080961a26557f14a653)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:04.681719 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:04.715371 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ee258a4324453d852ec8a471a92279'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.716174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ee258a4324453d852ec8a471a92279'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.716952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ee258a4324453d852ec8a471a92279'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.727013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ee258a4324453d852ec8a471a92279'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.736560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-fa22d5aa-7744-4e4d-9e2d-b4323161158a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ee258a4324453d852ec8a471a92279'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.742469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcdc87aee63c4080961a26557f14a653'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.751818 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcdc87aee63c4080961a26557f14a653'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.752850 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcdc87aee63c4080961a26557f14a653'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.760071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1380/2736] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:04 2022] DELETE /identity/v3/users/f6ee258a4324453d852ec8a471a92279 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:04.765219 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff65973-9a92-4c02-9042-9fdcd149f21f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.765453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff65973-9a92-4c02-9042-9fdcd149f21f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.765770 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff65973-9a92-4c02-9042-9fdcd149f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.779299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcdc87aee63c4080961a26557f14a653'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.780046 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-58fb3b9b-cc75-4db7-97f8-a9d3a98aa680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcdc87aee63c4080961a26557f14a653'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:04.790996 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-7ff65973-9a92-4c02-9042-9fdcd149f21f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:04.792270 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7ff65973-9a92-4c02-9042-9fdcd149f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:04.800703 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1357/2737] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:04 2022] DELETE /identity/v3/users/dcdc87aee63c4080961a26557f14a653 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:04.806969 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147598f-271d-4c86-93d7-4624c83484fd None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.807297 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147598f-271d-4c86-93d7-4624c83484fd None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.807579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147598f-271d-4c86-93d7-4624c83484fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:04.834372 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f147598f-271d-4c86-93d7-4624c83484fd None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:04.835633 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f147598f-271d-4c86-93d7-4624c83484fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:04.886301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1381/2738] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:53:04.897430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff65973-9a92-4c02-9042-9fdcd149f21f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.898876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7ff65973-9a92-4c02-9042-9fdcd149f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:04.903467 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1358/2739] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:04.914171 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147598f-271d-4c86-93d7-4624c83484fd None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:04.915634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f147598f-271d-4c86-93d7-4624c83484fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:04.965076 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff65973-9a92-4c02-9042-9fdcd149f21f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.973131 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:04.986332 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147598f-271d-4c86-93d7-4624c83484fd None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:04.990307 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294827b-f14b-4a25-9a73-a20ae6b538a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:04.991085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294827b-f14b-4a25-9a73-a20ae6b538a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:04.991375 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294827b-f14b-4a25-9a73-a20ae6b538a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:04.991652 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294827b-f14b-4a25-9a73-a20ae6b538a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.002131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294827b-f14b-4a25-9a73-a20ae6b538a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:05.003750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294827b-f14b-4a25-9a73-a20ae6b538a5 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:05.009639 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:05.017219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1359/2740] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:53:05.020854 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd85b69-779e-4895-9599-8aa1d3cecf33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:05.021998 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd85b69-779e-4895-9599-8aa1d3cecf33 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:05.022269 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd85b69-779e-4895-9599-8aa1d3cecf33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:05.022535 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd85b69-779e-4895-9599-8aa1d3cecf33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.032150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd85b69-779e-4895-9599-8aa1d3cecf33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:05.033433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd85b69-779e-4895-9599-8aa1d3cecf33 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:05.043476 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1382/2741] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:53:05.386965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294827b-f14b-4a25-9a73-a20ae6b538a5 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:05.388644 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b294827b-f14b-4a25-9a73-a20ae6b538a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:05.402905 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294827b-f14b-4a25-9a73-a20ae6b538a5 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:05.405759 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd85b69-779e-4895-9599-8aa1d3cecf33 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:05.407919 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-dbd85b69-779e-4895-9599-8aa1d3cecf33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:05.409947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:05.410586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:05.410892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:05.411198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] PATH_INFO: `/v3/projects/5a41d5d805824dce90abec6f354b730f` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.412368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a41d5d805824dce90abec6f354b730f)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:05.414448 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:05.431958 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd85b69-779e-4895-9599-8aa1d3cecf33 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:05.437866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:05.438626 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:05.438968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:05.439303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] PATH_INFO: `/v3/projects/1b32316136164d55801562ef63fe09f4` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.440499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b32316136164d55801562ef63fe09f4)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:05.442414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:05.466798 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a41d5d805824dce90abec6f354b730f', 'request_id': 'req-4098079a-6ae5-4a2c-82e3-6054629d87d1'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.476848 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a41d5d805824dce90abec6f354b730f', 'request_id': 'req-4098079a-6ae5-4a2c-82e3-6054629d87d1'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.483154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a41d5d805824dce90abec6f354b730f', 'request_id': 'req-4098079a-6ae5-4a2c-82e3-6054629d87d1'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.496185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] The token cache is being invalidate because project 5a41d5d805824dce90abec6f354b730f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:05.496483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.497238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.498303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b32316136164d55801562ef63fe09f4', 'request_id': 'req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.498888 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1360/2742] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:05 2022] DELETE /identity/v3/projects/5a41d5d805824dce90abec6f354b730f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:05.502864 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:05.505150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:05.507029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b32316136164d55801562ef63fe09f4', 'request_id': 'req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.514718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b32316136164d55801562ef63fe09f4', 'request_id': 'req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.530685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] The token cache is being invalidate because project 1b32316136164d55801562ef63fe09f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:05.531171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.532384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-8db052ee-bf65-4f1e-ad03-3a85cee7d3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.538294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1383/2743] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:05 2022] DELETE /identity/v3/projects/1b32316136164d55801562ef63fe09f4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:05.543848 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f64518-0d47-44cf-b3f7-e2f89b6d9b49 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:05.544205 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f64518-0d47-44cf-b3f7-e2f89b6d9b49 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:05.544555 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f64518-0d47-44cf-b3f7-e2f89b6d9b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.572966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-d5f64518-0d47-44cf-b3f7-e2f89b6d9b49 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:05.575470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-d5f64518-0d47-44cf-b3f7-e2f89b6d9b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:05.584999 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098079a-6ae5-4a2c-82e3-6054629d87d1 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:05.660208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1384/2744] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:05.669387 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:05.669907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181c931-f063-4439-b42c-80a8865f895f None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:05.670045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:05.670309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:05.670581 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] PATH_INFO: `/v3/users/8ad14ef1e1f4434299601871b1d43d54` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.670740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181c931-f063-4439-b42c-80a8865f895f None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:05.671069 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181c931-f063-4439-b42c-80a8865f895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.671892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad14ef1e1f4434299601871b1d43d54)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:05.673824 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:05.691512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c181c931-f063-4439-b42c-80a8865f895f None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:05.692754 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c181c931-f063-4439-b42c-80a8865f895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:05.701093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1385/2745] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:53:05.705702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181c931-f063-4439-b42c-80a8865f895f None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:05.714092 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:05.716377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181c931-f063-4439-b42c-80a8865f895f None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:05.721396 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4410e3d-a7b7-4b04-8981-7ae3da091a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:05.722326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410e3d-a7b7-4b04-8981-7ae3da091a13 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:05.722711 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410e3d-a7b7-4b04-8981-7ae3da091a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:05.723124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4410e3d-a7b7-4b04-8981-7ae3da091a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.724377 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4410e3d-a7b7-4b04-8981-7ae3da091a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:53:05.724863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4410e3d-a7b7-4b04-8981-7ae3da091a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:05.726249 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4410e3d-a7b7-4b04-8981-7ae3da091a13 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:05.730199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad14ef1e1f4434299601871b1d43d54'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.737576 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad14ef1e1f4434299601871b1d43d54'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.742369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad14ef1e1f4434299601871b1d43d54'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.742578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1386/2746] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:53:05.743574 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4410e3d-a7b7-4b04-8981-7ae3da091a13 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:05.753251 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad14ef1e1f4434299601871b1d43d54'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.753968 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad14ef1e1f4434299601871b1d43d54'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:05.754716 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4410e3d-a7b7-4b04-8981-7ae3da091a13 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:05.759930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320142d4-76a3-4f79-b7c7-4d36a6fabefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:05.760699 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320142d4-76a3-4f79-b7c7-4d36a6fabefd admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:05.761066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320142d4-76a3-4f79-b7c7-4d36a6fabefd admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:05.761444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320142d4-76a3-4f79-b7c7-4d36a6fabefd admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.762268 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320142d4-76a3-4f79-b7c7-4d36a6fabefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:05.764628 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320142d4-76a3-4f79-b7c7-4d36a6fabefd admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:05.769438 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1361/2747] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:05 2022] DELETE /identity/v3/users/8ad14ef1e1f4434299601871b1d43d54 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:05.784912 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:05.804335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1387/2748] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:05 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:05.805845 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:05.807455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:05.898664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab62b-f249-4eca-8e5b-b167709acc21 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:05.988098 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badc185-88d8-42a7-a1af-926945305f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:05.988997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badc185-88d8-42a7-a1af-926945305f89 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:05.989131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badc185-88d8-42a7-a1af-926945305f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:05.989437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badc185-88d8-42a7-a1af-926945305f89 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:05.991108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badc185-88d8-42a7-a1af-926945305f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:05.993057 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badc185-88d8-42a7-a1af-926945305f89 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.027198 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1362/2749] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:05 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:06.027897 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320142d4-76a3-4f79-b7c7-4d36a6fabefd admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.044387 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320142d4-76a3-4f79-b7c7-4d36a6fabefd admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.050973 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870510e3-e334-421e-a024-bbc1c4e23594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.051710 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870510e3-e334-421e-a024-bbc1c4e23594 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.052157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870510e3-e334-421e-a024-bbc1c4e23594 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.053285 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870510e3-e334-421e-a024-bbc1c4e23594 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.054509 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870510e3-e334-421e-a024-bbc1c4e23594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.056252 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870510e3-e334-421e-a024-bbc1c4e23594 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.070812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1388/2750] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:53:06.072965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badc185-88d8-42a7-a1af-926945305f89 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.084772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badc185-88d8-42a7-a1af-926945305f89 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.090721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc4d30-a032-42ec-8980-aae0d0eacbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.091360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc4d30-a032-42ec-8980-aae0d0eacbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.092207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc4d30-a032-42ec-8980-aae0d0eacbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.092207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc4d30-a032-42ec-8980-aae0d0eacbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.092536 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc4d30-a032-42ec-8980-aae0d0eacbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.094117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc4d30-a032-42ec-8980-aae0d0eacbe7 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.108113 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1363/2751] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:06.113356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870510e3-e334-421e-a024-bbc1c4e23594 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.120432 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc4d30-a032-42ec-8980-aae0d0eacbe7 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.122560 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7adc4d30-a032-42ec-8980-aae0d0eacbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:06.131117 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870510e3-e334-421e-a024-bbc1c4e23594 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.137784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc4d30-a032-42ec-8980-aae0d0eacbe7 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.143441 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7e7a-c2cd-4666-a7ed-fc0b15c1fc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.143892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.144617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7e7a-c2cd-4666-a7ed-fc0b15c1fc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.144744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.145088 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.145466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] PATH_INFO: `/v3/projects/53a1097e2e754d45b988817e57e0c5a8` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.147477 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a1097e2e754d45b988817e57e0c5a8)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.147828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7e7a-c2cd-4666-a7ed-fc0b15c1fc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.148307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7e7a-c2cd-4666-a7ed-fc0b15c1fc5c admin admin] PATH_INFO: `/v3/projects/82a464c062a34028b24c245df1f4f908/users/d08d6bfb1f95439db0a2619c4f811a6b/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.149738 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.179984 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff7e7a-c2cd-4666-a7ed-fc0b15c1fc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a464c062a34028b24c245df1f4f908, user_id=d08d6bfb1f95439db0a2619c4f811a6b, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.182677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff7e7a-c2cd-4666-a7ed-fc0b15c1fc5c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.194440 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:06.198867 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1389/2752] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:06 2022] PUT /identity/v3/projects/82a464c062a34028b24c245df1f4f908/users/d08d6bfb1f95439db0a2619c4f811a6b/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:06.211165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738e049-cce5-48f0-8cca-16b5f6362766 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.211525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738e049-cce5-48f0-8cca-16b5f6362766 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.211968 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738e049-cce5-48f0-8cca-16b5f6362766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.214073 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a1097e2e754d45b988817e57e0c5a8', 'request_id': 'req-9b26503b-bd5b-4f85-b071-85b87cd6392d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:06.223097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a1097e2e754d45b988817e57e0c5a8', 'request_id': 'req-9b26503b-bd5b-4f85-b071-85b87cd6392d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:06.230469 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a1097e2e754d45b988817e57e0c5a8', 'request_id': 'req-9b26503b-bd5b-4f85-b071-85b87cd6392d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:06.243645 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] The token cache is being invalidate because project 53a1097e2e754d45b988817e57e0c5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:06.244037 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:06.244797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-9b26503b-bd5b-4f85-b071-85b87cd6392d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:06.249684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1364/2753] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:06 2022] DELETE /identity/v3/projects/53a1097e2e754d45b988817e57e0c5a8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:06.249860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f738e049-cce5-48f0-8cca-16b5f6362766 None None] MFA Rules not processed for user `d08d6bfb1f95439db0a2619c4f811a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:06.249860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f738e049-cce5-48f0-8cca-16b5f6362766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:06.251803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b34ce-165e-4b44-bd10-7cac631a2508 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.252299 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b34ce-165e-4b44-bd10-7cac631a2508 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.252828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b34ce-165e-4b44-bd10-7cac631a2508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.276863 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-fb3b34ce-165e-4b44-bd10-7cac631a2508 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:06.278538 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fb3b34ce-165e-4b44-bd10-7cac631a2508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:06.331323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1390/2754] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:53:06.364013 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1365/2755] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:53:06.376269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b34ce-165e-4b44-bd10-7cac631a2508 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.376862 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd187e0-2fb7-4467-bc52-30ab3c02a5a7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.377766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fb3b34ce-165e-4b44-bd10-7cac631a2508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:06.377952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd187e0-2fb7-4467-bc52-30ab3c02a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.378325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd187e0-2fb7-4467-bc52-30ab3c02a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.414015 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-8dd187e0-2fb7-4467-bc52-30ab3c02a5a7 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:06.416461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-8dd187e0-2fb7-4467-bc52-30ab3c02a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:06.430668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1391/2756] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:06.435071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd187e0-2fb7-4467-bc52-30ab3c02a5a7 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.446632 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd187e0-2fb7-4467-bc52-30ab3c02a5a7 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.451758 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebebcc9-ba8e-4afe-a58d-5ae88638a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.452389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebebcc9-ba8e-4afe-a58d-5ae88638a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.452665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebebcc9-ba8e-4afe-a58d-5ae88638a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.452954 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebebcc9-ba8e-4afe-a58d-5ae88638a8fc admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.453654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebebcc9-ba8e-4afe-a58d-5ae88638a8fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:53:06.453961 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebebcc9-ba8e-4afe-a58d-5ae88638a8fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.455644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebebcc9-ba8e-4afe-a58d-5ae88638a8fc admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.470568 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1392/2757] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:53:06.475163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebebcc9-ba8e-4afe-a58d-5ae88638a8fc admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.485907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebebcc9-ba8e-4afe-a58d-5ae88638a8fc admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.491421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3df8-c162-4b1c-9bb1-eab2f2715697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.492124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3df8-c162-4b1c-9bb1-eab2f2715697 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.492527 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3df8-c162-4b1c-9bb1-eab2f2715697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.492784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3df8-c162-4b1c-9bb1-eab2f2715697 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.493448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f3df8-c162-4b1c-9bb1-eab2f2715697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.496245 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f3df8-c162-4b1c-9bb1-eab2f2715697 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.535010 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1393/2758] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:06 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:06.538151 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3df8-c162-4b1c-9bb1-eab2f2715697 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.597246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b34ce-165e-4b44-bd10-7cac631a2508 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.635665 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3df8-c162-4b1c-9bb1-eab2f2715697 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.641444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9d008-6356-48ce-80f0-81d4cb326487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.642308 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d008-6356-48ce-80f0-81d4cb326487 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.642750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d008-6356-48ce-80f0-81d4cb326487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.643218 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d008-6356-48ce-80f0-81d4cb326487 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.644049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9d008-6356-48ce-80f0-81d4cb326487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.647006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9d008-6356-48ce-80f0-81d4cb326487 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.671562 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:06.674255 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544d461-3fb2-4db3-9b6e-287f9eb0749d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.674929 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544d461-3fb2-4db3-9b6e-287f9eb0749d service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.675193 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544d461-3fb2-4db3-9b6e-287f9eb0749d service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.675470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544d461-3fb2-4db3-9b6e-287f9eb0749d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.686543 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1394/2759] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:06 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:53:06.691993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9d008-6356-48ce-80f0-81d4cb326487 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.713167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:06.714105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9d008-6356-48ce-80f0-81d4cb326487 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.726891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a13fa-8b33-4c39-b126-3e02d045c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.727645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a13fa-8b33-4c39-b126-3e02d045c81b admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.728027 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a13fa-8b33-4c39-b126-3e02d045c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.728399 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a13fa-8b33-4c39-b126-3e02d045c81b admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.729159 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a13fa-8b33-4c39-b126-3e02d045c81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.730905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a13fa-8b33-4c39-b126-3e02d045c81b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.749845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1395/2760] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:06.753516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a13fa-8b33-4c39-b126-3e02d045c81b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.754735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544d461-3fb2-4db3-9b6e-287f9eb0749d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.756660 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544d461-3fb2-4db3-9b6e-287f9eb0749d service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.769358 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1366/2761] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:06.771800 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a13fa-8b33-4c39-b126-3e02d045c81b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.787644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b91943-eec0-4224-b789-81c3bceadbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.787644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91943-eec0-4224-b789-81c3bceadbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.787644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91943-eec0-4224-b789-81c3bceadbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.787644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91943-eec0-4224-b789-81c3bceadbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.788008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b91943-eec0-4224-b789-81c3bceadbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.788008 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b91943-eec0-4224-b789-81c3bceadbb9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.798959 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1396/2762] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:06.802957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544d461-3fb2-4db3-9b6e-287f9eb0749d service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.816709 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544d461-3fb2-4db3-9b6e-287f9eb0749d service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:06.821745 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e48eb-2a3b-4887-843c-cc1e1233304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:06.822645 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e48eb-2a3b-4887-843c-cc1e1233304d admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.823187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e48eb-2a3b-4887-843c-cc1e1233304d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.823693 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e48eb-2a3b-4887-843c-cc1e1233304d admin admin] PATH_INFO: `/v3/projects/d340b67f361a490fbbca9ceb92275b6c/users/1e0fa727391f41ec96ad3a0d83c14ed9/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.843183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e48eb-2a3b-4887-843c-cc1e1233304d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d340b67f361a490fbbca9ceb92275b6c, user_id=1e0fa727391f41ec96ad3a0d83c14ed9, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:06.846078 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e48eb-2a3b-4887-843c-cc1e1233304d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:06.865983 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1367/2763] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:06 2022] PUT /identity/v3/projects/d340b67f361a490fbbca9ceb92275b6c/users/1e0fa727391f41ec96ad3a0d83c14ed9/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:06.866368 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b91943-eec0-4224-b789-81c3bceadbb9 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:06.868148 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-37b91943-eec0-4224-b789-81c3bceadbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:06.881237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0170c-535e-4120-92d4-a630a80e9f63 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:06.881515 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0170c-535e-4120-92d4-a630a80e9f63 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:06.881787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0170c-535e-4120-92d4-a630a80e9f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:06.941192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-14e0170c-535e-4120-92d4-a630a80e9f63 None None] MFA Rules not processed for user `1e0fa727391f41ec96ad3a0d83c14ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:06.941192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-14e0170c-535e-4120-92d4-a630a80e9f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:06.968140 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b91943-eec0-4224-b789-81c3bceadbb9 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:07.049832 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0226f13-34e8-497f-8d5d-f38042eb6e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:07.051024 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0226f13-34e8-497f-8d5d-f38042eb6e6e service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:07.051465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0226f13-34e8-497f-8d5d-f38042eb6e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:07.051937 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0226f13-34e8-497f-8d5d-f38042eb6e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:07.052132 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1368/2764] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:07.054275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c0226f13-34e8-497f-8d5d-f38042eb6e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:07.055075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0170c-535e-4120-92d4-a630a80e9f63 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:07.065188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0226f13-34e8-497f-8d5d-f38042eb6e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:07.067327 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0226f13-34e8-497f-8d5d-f38042eb6e6e service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:07.077992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1397/2765] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:53:07.157455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0170c-535e-4120-92d4-a630a80e9f63 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:07.165837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e070b90-6f97-45dc-840e-fbf6d4c4f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:07.166578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e070b90-6f97-45dc-840e-fbf6d4c4f09c admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:07.167568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e070b90-6f97-45dc-840e-fbf6d4c4f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:07.167856 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e070b90-6f97-45dc-840e-fbf6d4c4f09c admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:07.168628 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e070b90-6f97-45dc-840e-fbf6d4c4f09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:07.172000 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e070b90-6f97-45dc-840e-fbf6d4c4f09c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:07.212722 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1369/2766] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:07 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:07.213890 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0226f13-34e8-497f-8d5d-f38042eb6e6e service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:07.228439 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0226f13-34e8-497f-8d5d-f38042eb6e6e service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:07.356309 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c36e1-1ecb-4187-9652-09a65daf9f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:07.358542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c36e1-1ecb-4187-9652-09a65daf9f7f admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:07.359689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c36e1-1ecb-4187-9652-09a65daf9f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:07.360267 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c36e1-1ecb-4187-9652-09a65daf9f7f admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:07.364314 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c36e1-1ecb-4187-9652-09a65daf9f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:07.369495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c36e1-1ecb-4187-9652-09a65daf9f7f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:07.416043 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1398/2767] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:07 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:07.417667 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e070b90-6f97-45dc-840e-fbf6d4c4f09c admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:07.430402 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e070b90-6f97-45dc-840e-fbf6d4c4f09c admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:07.435662 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d306b35-9033-42be-b4f0-98779911ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:07.436352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d306b35-9033-42be-b4f0-98779911ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:07.436696 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d306b35-9033-42be-b4f0-98779911ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:07.437033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d306b35-9033-42be-b4f0-98779911ccf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:07.437917 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d306b35-9033-42be-b4f0-98779911ccf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:07.439687 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d306b35-9033-42be-b4f0-98779911ccf3 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:07.455879 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1370/2768] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:07.461335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c36e1-1ecb-4187-9652-09a65daf9f7f admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:07.472503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c36e1-1ecb-4187-9652-09a65daf9f7f admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:07.477447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125b814-8f4e-40bc-8042-0409cb8ad533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:07.478140 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b814-8f4e-40bc-8042-0409cb8ad533 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:07.478471 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b814-8f4e-40bc-8042-0409cb8ad533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:07.478794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b814-8f4e-40bc-8042-0409cb8ad533 admin admin] PATH_INFO: `/v3/projects/52ecce414f1544ca8715ae298551bf99/users/d86051f34e15402b8c53494af19a5bdb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:07.498920 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125b814-8f4e-40bc-8042-0409cb8ad533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ecce414f1544ca8715ae298551bf99, user_id=d86051f34e15402b8c53494af19a5bdb, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:07.502733 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125b814-8f4e-40bc-8042-0409cb8ad533 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:07.515447 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:07.524750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1399/2769] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:07 2022] PUT /identity/v3/projects/52ecce414f1544ca8715ae298551bf99/users/d86051f34e15402b8c53494af19a5bdb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:07.529346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d306b35-9033-42be-b4f0-98779911ccf3 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:07.540988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d306b35-9033-42be-b4f0-98779911ccf3 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:07.546416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:07.628551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0bd67-cd83-431c-9f79-dd058b13a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:07.629167 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0bd67-cd83-431c-9f79-dd058b13a296 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:07.629530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0bd67-cd83-431c-9f79-dd058b13a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:07.629846 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0bd67-cd83-431c-9f79-dd058b13a296 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:07.630750 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0bd67-cd83-431c-9f79-dd058b13a296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:07.632513 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0bd67-cd83-431c-9f79-dd058b13a296 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:07.648666 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1371/2770] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:07.653822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125b814-8f4e-40bc-8042-0409cb8ad533 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:07.665481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125b814-8f4e-40bc-8042-0409cb8ad533 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:07.670992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce1fd5-5f13-4bb9-972b-3989b1ca31ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:07.671827 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1fd5-5f13-4bb9-972b-3989b1ca31ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:07.672172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1fd5-5f13-4bb9-972b-3989b1ca31ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:07.672513 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1fd5-5f13-4bb9-972b-3989b1ca31ef admin admin] PATH_INFO: `/v3/projects/52ecce414f1544ca8715ae298551bf99/users/d86051f34e15402b8c53494af19a5bdb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:07.675176 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce1fd5-5f13-4bb9-972b-3989b1ca31ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ecce414f1544ca8715ae298551bf99, user_id=d86051f34e15402b8c53494af19a5bdb, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:07.679630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce1fd5-5f13-4bb9-972b-3989b1ca31ef admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:07.717479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1400/2771] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:07 2022] PUT /identity/v3/projects/52ecce414f1544ca8715ae298551bf99/users/d86051f34e15402b8c53494af19a5bdb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:07.729343 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7be590-03cd-4e8e-8a76-1c6703ff159e None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:07.729679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7be590-03cd-4e8e-8a76-1c6703ff159e None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:07.729883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7be590-03cd-4e8e-8a76-1c6703ff159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:07.798441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-7f7be590-03cd-4e8e-8a76-1c6703ff159e None None] MFA Rules not processed for user `d86051f34e15402b8c53494af19a5bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:07.799766 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-7f7be590-03cd-4e8e-8a76-1c6703ff159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:07.886256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1372/2772] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:07.893301 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce1fd5-5f13-4bb9-972b-3989b1ca31ef admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:07.895464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-19ce1fd5-5f13-4bb9-972b-3989b1ca31ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:07.978705 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce1fd5-5f13-4bb9-972b-3989b1ca31ef admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:07.982868 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b433a64-76d9-42c6-86d9-4c7744deb690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:07.983492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b433a64-76d9-42c6-86d9-4c7744deb690 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:07.983940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b433a64-76d9-42c6-86d9-4c7744deb690 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:07.984140 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b433a64-76d9-42c6-86d9-4c7744deb690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:07.994630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b433a64-76d9-42c6-86d9-4c7744deb690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:07.996130 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b433a64-76d9-42c6-86d9-4c7744deb690 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:08.011962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1401/2773] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:08.085656 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7be590-03cd-4e8e-8a76-1c6703ff159e None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:08.160334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7be590-03cd-4e8e-8a76-1c6703ff159e None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:08.166837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:08.167490 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:08.167779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:08.168055 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] PATH_INFO: `/v3/users/1e0fa727391f41ec96ad3a0d83c14ed9` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:08.169206 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0fa727391f41ec96ad3a0d83c14ed9)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:08.171158 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:08.214166 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:08.229671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0fa727391f41ec96ad3a0d83c14ed9'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:08.237096 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0fa727391f41ec96ad3a0d83c14ed9'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:08.237842 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0fa727391f41ec96ad3a0d83c14ed9'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:08.252401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0fa727391f41ec96ad3a0d83c14ed9'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:08.253516 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0fa727391f41ec96ad3a0d83c14ed9'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:08.270022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1373/2774] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:08 2022] DELETE /identity/v3/users/1e0fa727391f41ec96ad3a0d83c14ed9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:08.275229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104b5fa-152f-483c-b238-c775ff6a28c0 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:08.275822 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104b5fa-152f-483c-b238-c775ff6a28c0 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:08.276340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104b5fa-152f-483c-b238-c775ff6a28c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:08.433489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c104b5fa-152f-483c-b238-c775ff6a28c0 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:08.434105 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c104b5fa-152f-483c-b238-c775ff6a28c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:08.523221 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1402/2775] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:08.534705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:08.536830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:08.607430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1b634-417a-4093-a8fc-390e30cc07eb admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:08.611829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacfbea-72ed-4619-bf15-d1d493b29e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:08.613443 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacfbea-72ed-4619-bf15-d1d493b29e76 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:08.613821 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacfbea-72ed-4619-bf15-d1d493b29e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:08.614105 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacfbea-72ed-4619-bf15-d1d493b29e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:08.629878 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacfbea-72ed-4619-bf15-d1d493b29e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:08.632491 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacfbea-72ed-4619-bf15-d1d493b29e76 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:08.653981 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1374/2776] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:09.039721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104b5fa-152f-483c-b238-c775ff6a28c0 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:09.043168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c104b5fa-152f-483c-b238-c775ff6a28c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:09.060907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104b5fa-152f-483c-b238-c775ff6a28c0 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:09.072575 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:09.073520 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:09.073999 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:09.074428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] PATH_INFO: `/v3/projects/d340b67f361a490fbbca9ceb92275b6c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:09.075813 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d340b67f361a490fbbca9ceb92275b6c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:09.078475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:09.144654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd340b67f361a490fbbca9ceb92275b6c', 'request_id': 'req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.152460 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd340b67f361a490fbbca9ceb92275b6c', 'request_id': 'req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.158326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd340b67f361a490fbbca9ceb92275b6c', 'request_id': 'req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.173088 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] The token cache is being invalidate because project d340b67f361a490fbbca9ceb92275b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:09.173395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.174000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.175668 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1403/2777] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:09 2022] DELETE /identity/v3/projects/d340b67f361a490fbbca9ceb92275b6c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:09.180200 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacfbea-72ed-4619-bf15-d1d493b29e76 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:09.190370 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacfbea-72ed-4619-bf15-d1d493b29e76 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:09.255487 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:09.256500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:09.256781 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:09.257060 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] PATH_INFO: `/v3/users/d86051f34e15402b8c53494af19a5bdb` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:09.258231 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86051f34e15402b8c53494af19a5bdb)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:09.260185 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:09.327342 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86051f34e15402b8c53494af19a5bdb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.341383 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:09.344780 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86051f34e15402b8c53494af19a5bdb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.345815 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86051f34e15402b8c53494af19a5bdb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.362623 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86051f34e15402b8c53494af19a5bdb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.364226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-f2e88cd7-e153-4da9-9774-2ba634e3783d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86051f34e15402b8c53494af19a5bdb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.386025 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1375/2778] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:09 2022] DELETE /identity/v3/users/d86051f34e15402b8c53494af19a5bdb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:09.700830 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:09.706212 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:09.757738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e00b0c-5e73-488f-a5d8-1f0c57af7e3e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:09.786663 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:09.876451 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:09.877796 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:09.878491 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:09.878658 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] PATH_INFO: `/v3/projects/52ecce414f1544ca8715ae298551bf99` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:09.882325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ecce414f1544ca8715ae298551bf99)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:09.884689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:09.980430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ecce414f1544ca8715ae298551bf99', 'request_id': 'req-3b9bd584-986a-438e-b97f-7f19de18f9fb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:09.995279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ecce414f1544ca8715ae298551bf99', 'request_id': 'req-3b9bd584-986a-438e-b97f-7f19de18f9fb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:10.018215 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ecce414f1544ca8715ae298551bf99', 'request_id': 'req-3b9bd584-986a-438e-b97f-7f19de18f9fb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:10.040930 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] The token cache is being invalidate because project 52ecce414f1544ca8715ae298551bf99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:10.041351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:10.043275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3b9bd584-986a-438e-b97f-7f19de18f9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:10.045556 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1404/2779] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:09 2022] DELETE /identity/v3/projects/52ecce414f1544ca8715ae298551bf99 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:10.049987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f575-9cde-49f4-99a3-c523b2efe56d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.050334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f575-9cde-49f4-99a3-c523b2efe56d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.050649 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f575-9cde-49f4-99a3-c523b2efe56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.093012 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-a1b0f575-9cde-49f4-99a3-c523b2efe56d None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:10.096391 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-a1b0f575-9cde-49f4-99a3-c523b2efe56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:10.229676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1376/2780] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:10.237899 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b3d06-17be-43ee-a30e-ef120af64b4e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.238214 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b3d06-17be-43ee-a30e-ef120af64b4e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.238515 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b3d06-17be-43ee-a30e-ef120af64b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.261567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-f10b3d06-17be-43ee-a30e-ef120af64b4e None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:10.262905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f10b3d06-17be-43ee-a30e-ef120af64b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:10.272220 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1405/2781] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:10.277503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0f575-9cde-49f4-99a3-c523b2efe56d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:10.289225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0f575-9cde-49f4-99a3-c523b2efe56d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:10.295041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939d3e4-6ed9-4c68-bc26-cd85f548e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:10.295961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939d3e4-6ed9-4c68-bc26-cd85f548e434 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.296373 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939d3e4-6ed9-4c68-bc26-cd85f548e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.296648 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939d3e4-6ed9-4c68-bc26-cd85f548e434 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.297315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939d3e4-6ed9-4c68-bc26-cd85f548e434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:53:10.297616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939d3e4-6ed9-4c68-bc26-cd85f548e434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:10.299245 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939d3e4-6ed9-4c68-bc26-cd85f548e434 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:10.312578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1377/2782] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:53:10.317233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b3d06-17be-43ee-a30e-ef120af64b4e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:10.327570 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b3d06-17be-43ee-a30e-ef120af64b4e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:10.332253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdff45-266d-4902-862e-62199a18e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:10.332864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdff45-266d-4902-862e-62199a18e398 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.333165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdff45-266d-4902-862e-62199a18e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.333436 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdff45-266d-4902-862e-62199a18e398 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.334139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdff45-266d-4902-862e-62199a18e398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:10.336097 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdff45-266d-4902-862e-62199a18e398 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:10.364952 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1406/2783] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:10 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:10.369268 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939d3e4-6ed9-4c68-bc26-cd85f548e434 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:10.378956 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939d3e4-6ed9-4c68-bc26-cd85f548e434 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:10.442734 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99165ba8-f025-4bd2-bae3-20b3d4c331c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:10.443521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99165ba8-f025-4bd2-bae3-20b3d4c331c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.443811 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99165ba8-f025-4bd2-bae3-20b3d4c331c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.444090 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99165ba8-f025-4bd2-bae3-20b3d4c331c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.444731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99165ba8-f025-4bd2-bae3-20b3d4c331c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:10.446957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99165ba8-f025-4bd2-bae3-20b3d4c331c4 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:10.471078 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1378/2784] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:10 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:53:10.475427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdff45-266d-4902-862e-62199a18e398 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:10.486696 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdff45-266d-4902-862e-62199a18e398 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:10.492307 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467eae-3374-4534-81e0-f488b7db245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:10.492916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467eae-3374-4534-81e0-f488b7db245e admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.493196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467eae-3374-4534-81e0-f488b7db245e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.493459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467eae-3374-4534-81e0-f488b7db245e admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.494095 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae467eae-3374-4534-81e0-f488b7db245e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:10.495722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae467eae-3374-4534-81e0-f488b7db245e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:10.507276 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1407/2785] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:10.511458 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99165ba8-f025-4bd2-bae3-20b3d4c331c4 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:10.524029 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99165ba8-f025-4bd2-bae3-20b3d4c331c4 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:10.529340 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dc171-390a-4b10-9f5a-d65c9c60240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:10.529949 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dc171-390a-4b10-9f5a-d65c9c60240f admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.530225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dc171-390a-4b10-9f5a-d65c9c60240f admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.530492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dc171-390a-4b10-9f5a-d65c9c60240f admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.531174 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dc171-390a-4b10-9f5a-d65c9c60240f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:10.532761 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dc171-390a-4b10-9f5a-d65c9c60240f admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:10.544978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1379/2786] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:10.549349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467eae-3374-4534-81e0-f488b7db245e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:10.575922 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467eae-3374-4534-81e0-f488b7db245e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:10.581814 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba1e8b-b6d1-48b6-89d7-25c9c7a31bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:10.582450 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba1e8b-b6d1-48b6-89d7-25c9c7a31bed admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.582736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba1e8b-b6d1-48b6-89d7-25c9c7a31bed admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.583680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba1e8b-b6d1-48b6-89d7-25c9c7a31bed admin admin] PATH_INFO: `/v3/projects/169f06e71eed4b2394e9bc6ab37168a5/users/2660a37386e84e2fa5ab7476a9e2ebed/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.603169 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba1e8b-b6d1-48b6-89d7-25c9c7a31bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=169f06e71eed4b2394e9bc6ab37168a5, user_id=2660a37386e84e2fa5ab7476a9e2ebed, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:10.606290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba1e8b-b6d1-48b6-89d7-25c9c7a31bed admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:10.621560 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1408/2787] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:10 2022] PUT /identity/v3/projects/169f06e71eed4b2394e9bc6ab37168a5/users/2660a37386e84e2fa5ab7476a9e2ebed/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:10.634016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54c90-775e-46c5-afbd-49c63285b02d None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.634388 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54c90-775e-46c5-afbd-49c63285b02d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.634730 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54c90-775e-46c5-afbd-49c63285b02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.670492 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-8bd54c90-775e-46c5-afbd-49c63285b02d None None] MFA Rules not processed for user `2660a37386e84e2fa5ab7476a9e2ebed`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:10.672616 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-8bd54c90-775e-46c5-afbd-49c63285b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:10.703179 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:10.747946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1380/2788] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:10 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:53:10.752893 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba1e8b-b6d1-48b6-89d7-25c9c7a31bed admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:10.800233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:10.824966 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba1e8b-b6d1-48b6-89d7-25c9c7a31bed admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:10.829776 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c829-a235-41b1-acf0-2af378f393f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:10.830407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c829-a235-41b1-acf0-2af378f393f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.830707 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c829-a235-41b1-acf0-2af378f393f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.831006 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c829-a235-41b1-acf0-2af378f393f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.831642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c829-a235-41b1-acf0-2af378f393f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:10.833656 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c829-a235-41b1-acf0-2af378f393f7 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:10.867171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1409/2789] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:10 2022] POST /identity/v3/projects => generated 397 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:10.869470 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54c90-775e-46c5-afbd-49c63285b02d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:10.881716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54c90-775e-46c5-afbd-49c63285b02d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:10.962521 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf012e-4a54-4a89-a8b3-9a56dff80d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:10.963188 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf012e-4a54-4a89-a8b3-9a56dff80d6d admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:10.963534 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf012e-4a54-4a89-a8b3-9a56dff80d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:10.963810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf012e-4a54-4a89-a8b3-9a56dff80d6d admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:10.964472 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf012e-4a54-4a89-a8b3-9a56dff80d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:10.966401 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf012e-4a54-4a89-a8b3-9a56dff80d6d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:10.991479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1381/2790] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:10 2022] POST /identity/v3/users => generated 305 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:53:10.992789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c829-a235-41b1-acf0-2af378f393f7 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:11.003625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c829-a235-41b1-acf0-2af378f393f7 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:11.009762 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97fced-e7e2-4b49-ba01-519b63689736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:11.010406 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97fced-e7e2-4b49-ba01-519b63689736 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:11.010693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97fced-e7e2-4b49-ba01-519b63689736 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:11.011000 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97fced-e7e2-4b49-ba01-519b63689736 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:11.011643 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97fced-e7e2-4b49-ba01-519b63689736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:11.013253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97fced-e7e2-4b49-ba01-519b63689736 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:11.028479 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1410/2791] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:11.031403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf012e-4a54-4a89-a8b3-9a56dff80d6d admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:11.042547 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf012e-4a54-4a89-a8b3-9a56dff80d6d admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:11.047559 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7354b1d-3edd-45a2-8391-6829c60c9745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:11.048116 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7354b1d-3edd-45a2-8391-6829c60c9745 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:11.048396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7354b1d-3edd-45a2-8391-6829c60c9745 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:11.048661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7354b1d-3edd-45a2-8391-6829c60c9745 admin admin] PATH_INFO: `/v3/projects/e60f0fe97e284dc7a09b9936e7b448d8/users/a9117d07b2e04e6fa2774257730b1ceb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:11.070156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7354b1d-3edd-45a2-8391-6829c60c9745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60f0fe97e284dc7a09b9936e7b448d8, user_id=a9117d07b2e04e6fa2774257730b1ceb, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:11.073830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7354b1d-3edd-45a2-8391-6829c60c9745 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:11.094405 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1382/2792] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:11 2022] PUT /identity/v3/projects/e60f0fe97e284dc7a09b9936e7b448d8/users/a9117d07b2e04e6fa2774257730b1ceb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:11.095924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97fced-e7e2-4b49-ba01-519b63689736 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:11.107736 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97fced-e7e2-4b49-ba01-519b63689736 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:11.205888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80763a-3b85-40f5-9f96-038fe8363869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:11.206644 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80763a-3b85-40f5-9f96-038fe8363869 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:11.207065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80763a-3b85-40f5-9f96-038fe8363869 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:11.207415 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80763a-3b85-40f5-9f96-038fe8363869 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:11.209224 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80763a-3b85-40f5-9f96-038fe8363869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:11.210936 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80763a-3b85-40f5-9f96-038fe8363869 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:11.226041 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1411/2793] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:11.230634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7354b1d-3edd-45a2-8391-6829c60c9745 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:11.258390 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7354b1d-3edd-45a2-8391-6829c60c9745 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:11.263620 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161532c8-9049-411b-91bf-e7f693bad780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:11.264638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161532c8-9049-411b-91bf-e7f693bad780 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:11.264996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161532c8-9049-411b-91bf-e7f693bad780 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:11.265344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161532c8-9049-411b-91bf-e7f693bad780 admin admin] PATH_INFO: `/v3/projects/e60f0fe97e284dc7a09b9936e7b448d8/users/a9117d07b2e04e6fa2774257730b1ceb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:11.267544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161532c8-9049-411b-91bf-e7f693bad780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60f0fe97e284dc7a09b9936e7b448d8, user_id=a9117d07b2e04e6fa2774257730b1ceb, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:11.270278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161532c8-9049-411b-91bf-e7f693bad780 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:11.282984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1383/2794] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:11 2022] PUT /identity/v3/projects/e60f0fe97e284dc7a09b9936e7b448d8/users/a9117d07b2e04e6fa2774257730b1ceb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:11.295615 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fe023-ffec-4d20-ac38-0e52c20fcdbe None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:11.296094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fe023-ffec-4d20-ac38-0e52c20fcdbe None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:11.296556 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fe023-ffec-4d20-ac38-0e52c20fcdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:11.342257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-e29fe023-ffec-4d20-ac38-0e52c20fcdbe None None] MFA Rules not processed for user `a9117d07b2e04e6fa2774257730b1ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:11.344612 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e29fe023-ffec-4d20-ac38-0e52c20fcdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:11.432812 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1412/2795] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:11 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:11.446091 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161532c8-9049-411b-91bf-e7f693bad780 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:11.448125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-161532c8-9049-411b-91bf-e7f693bad780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:11.510512 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161532c8-9049-411b-91bf-e7f693bad780 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:11.514847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e73cdb-e2eb-4c4a-97be-9f0b53375111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:11.515454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e73cdb-e2eb-4c4a-97be-9f0b53375111 service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:11.515857 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e73cdb-e2eb-4c4a-97be-9f0b53375111 service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:11.516131 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e73cdb-e2eb-4c4a-97be-9f0b53375111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:11.526074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e73cdb-e2eb-4c4a-97be-9f0b53375111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:11.527974 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e73cdb-e2eb-4c4a-97be-9f0b53375111 service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:11.538290 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1384/2796] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:11.618312 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fe023-ffec-4d20-ac38-0e52c20fcdbe None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:11.628115 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fe023-ffec-4d20-ac38-0e52c20fcdbe None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:11.631882 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7892c0-a024-4783-a98d-a5ae2d05ad57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:11.632876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7892c0-a024-4783-a98d-a5ae2d05ad57 service cinder] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:11.633164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7892c0-a024-4783-a98d-a5ae2d05ad57 service cinder] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:11.633434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7892c0-a024-4783-a98d-a5ae2d05ad57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:11.668646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:11.696165 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7892c0-a024-4783-a98d-a5ae2d05ad57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:11.697590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7892c0-a024-4783-a98d-a5ae2d05ad57 service cinder] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:11.706884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1413/2797] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:11 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:12.206634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e73cdb-e2eb-4c4a-97be-9f0b53375111 service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:12.209175 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-69e73cdb-e2eb-4c4a-97be-9f0b53375111 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:12.239933 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:12.261540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7892c0-a024-4783-a98d-a5ae2d05ad57 service cinder] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:12.263071 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6b7892c0-a024-4783-a98d-a5ae2d05ad57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:12.290346 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e73cdb-e2eb-4c4a-97be-9f0b53375111 service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:12.297465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:12.298127 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:12.298411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:12.298684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] PATH_INFO: `/v3/users/d48b170f1d80418180d49f615ff11438` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:12.299887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48b170f1d80418180d49f615ff11438)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:12.301833 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:12.352356 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7892c0-a024-4783-a98d-a5ae2d05ad57 service cinder] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:12.358155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48b170f1d80418180d49f615ff11438'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.358333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:12.358905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:12.359188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:12.359458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] PATH_INFO: `/v3/users/d08d6bfb1f95439db0a2619c4f811a6b` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:12.360625 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08d6bfb1f95439db0a2619c4f811a6b)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:12.362563 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:12.366164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48b170f1d80418180d49f615ff11438'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.366965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48b170f1d80418180d49f615ff11438'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.384573 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48b170f1d80418180d49f615ff11438'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.385295 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-e59b5d21-f7a4-4ff6-8af1-aebea76c737a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48b170f1d80418180d49f615ff11438'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.401829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1385/2798] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:12 2022] DELETE /identity/v3/users/d48b170f1d80418180d49f615ff11438 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:12.406043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1e095-6570-4a1f-bfcf-996c2a343513 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:12.406337 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1e095-6570-4a1f-bfcf-996c2a343513 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:12.406674 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1e095-6570-4a1f-bfcf-996c2a343513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:12.418372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08d6bfb1f95439db0a2619c4f811a6b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.419540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08d6bfb1f95439db0a2619c4f811a6b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.420344 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08d6bfb1f95439db0a2619c4f811a6b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.428125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-fdd1e095-6570-4a1f-bfcf-996c2a343513 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:12.428593 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08d6bfb1f95439db0a2619c4f811a6b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.429360 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fdd1e095-6570-4a1f-bfcf-996c2a343513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:12.438462 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd7a5ff7-327a-4735-9fb7-8773692a8101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08d6bfb1f95439db0a2619c4f811a6b'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:12.465865 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1414/2799] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:12 2022] DELETE /identity/v3/users/d08d6bfb1f95439db0a2619c4f811a6b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:12.470202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ddf6d-acf0-47ba-ab4e-18926f12bdb7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:12.470673 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ddf6d-acf0-47ba-ab4e-18926f12bdb7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:12.471038 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ddf6d-acf0-47ba-ab4e-18926f12bdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:12.496766 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-569ddf6d-acf0-47ba-ab4e-18926f12bdb7 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:12.498079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-569ddf6d-acf0-47ba-ab4e-18926f12bdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:12.505982 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1386/2800] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:53:12.516716 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1e095-6570-4a1f-bfcf-996c2a343513 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:12.519940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-fdd1e095-6570-4a1f-bfcf-996c2a343513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:12.573397 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:12.579416 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:12.601145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1415/2801] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:12.602883 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1e095-6570-4a1f-bfcf-996c2a343513 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:12.620750 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ddf6d-acf0-47ba-ab4e-18926f12bdb7 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:12.666817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c096b4-9955-4a74-81b8-4efe0431af7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:12.667895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c096b4-9955-4a74-81b8-4efe0431af7a service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:12.668426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c096b4-9955-4a74-81b8-4efe0431af7a service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:12.668715 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c096b4-9955-4a74-81b8-4efe0431af7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:12.681114 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c096b4-9955-4a74-81b8-4efe0431af7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:12.683186 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c096b4-9955-4a74-81b8-4efe0431af7a service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:12.694509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1387/2802] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:12.696400 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ddf6d-acf0-47ba-ab4e-18926f12bdb7 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:12.700943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160260c-8062-4b19-b8c9-1bb9cdfd4eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:12.701516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160260c-8062-4b19-b8c9-1bb9cdfd4eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:12.702194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160260c-8062-4b19-b8c9-1bb9cdfd4eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:12.702194 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160260c-8062-4b19-b8c9-1bb9cdfd4eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:12.713857 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160260c-8062-4b19-b8c9-1bb9cdfd4eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:12.715504 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160260c-8062-4b19-b8c9-1bb9cdfd4eb3 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:12.727720 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1416/2803] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:53:13.450275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c096b4-9955-4a74-81b8-4efe0431af7a service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:13.451790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-61c096b4-9955-4a74-81b8-4efe0431af7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:13.468998 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160260c-8062-4b19-b8c9-1bb9cdfd4eb3 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:13.470178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6160260c-8062-4b19-b8c9-1bb9cdfd4eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:13.474051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c096b4-9955-4a74-81b8-4efe0431af7a service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:13.478887 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:13.479517 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:13.479794 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:13.480066 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] PATH_INFO: `/v3/projects/1aaa42b0a36547b49618934ac6fd41b0` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:13.481735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aaa42b0a36547b49618934ac6fd41b0)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:13.483679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:13.493017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160260c-8062-4b19-b8c9-1bb9cdfd4eb3 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:13.507160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:13.508659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:13.508940 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:13.509209 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] PATH_INFO: `/v3/projects/82a464c062a34028b24c245df1f4f908` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:13.510424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a464c062a34028b24c245df1f4f908)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:13.512516 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:13.542960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aaa42b0a36547b49618934ac6fd41b0', 'request_id': 'req-63e593e3-91b5-485c-b2ab-ddc4386a93ec'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.550356 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aaa42b0a36547b49618934ac6fd41b0', 'request_id': 'req-63e593e3-91b5-485c-b2ab-ddc4386a93ec'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.557584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aaa42b0a36547b49618934ac6fd41b0', 'request_id': 'req-63e593e3-91b5-485c-b2ab-ddc4386a93ec'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.564895 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a464c062a34028b24c245df1f4f908', 'request_id': 'req-9401d175-f7ce-4a85-9772-cf015b2c5edf'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.571240 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] The token cache is being invalidate because project 1aaa42b0a36547b49618934ac6fd41b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:13.571603 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.572334 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-63e593e3-91b5-485c-b2ab-ddc4386a93ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.572541 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a464c062a34028b24c245df1f4f908', 'request_id': 'req-9401d175-f7ce-4a85-9772-cf015b2c5edf'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.574063 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1388/2804] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:13 2022] DELETE /identity/v3/projects/1aaa42b0a36547b49618934ac6fd41b0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:13.587726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a464c062a34028b24c245df1f4f908', 'request_id': 'req-9401d175-f7ce-4a85-9772-cf015b2c5edf'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.602489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] The token cache is being invalidate because project 82a464c062a34028b24c245df1f4f908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:13.602835 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.603485 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-9401d175-f7ce-4a85-9772-cf015b2c5edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:13.605291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1417/2805] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:13 2022] DELETE /identity/v3/projects/82a464c062a34028b24c245df1f4f908 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:13.610466 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b00e0-fb38-4be6-9f59-7a24913358cc None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:13.610852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b00e0-fb38-4be6-9f59-7a24913358cc None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:13.611213 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b00e0-fb38-4be6-9f59-7a24913358cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:13.633926 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-bb4b00e0-fb38-4be6-9f59-7a24913358cc None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:13.635296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-bb4b00e0-fb38-4be6-9f59-7a24913358cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:13.705061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1389/2806] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:13.713343 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303402c-6635-4715-889e-aa98adef7eee None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:13.713685 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303402c-6635-4715-889e-aa98adef7eee None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:13.713891 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303402c-6635-4715-889e-aa98adef7eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:13.736048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6303402c-6635-4715-889e-aa98adef7eee None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:13.737291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6303402c-6635-4715-889e-aa98adef7eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:13.749969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1418/2807] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:13.751726 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b00e0-fb38-4be6-9f59-7a24913358cc None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:13.763083 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b00e0-fb38-4be6-9f59-7a24913358cc None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:13.772308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae0f51-6af9-49eb-ab0a-8018a985d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:13.773125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0f51-6af9-49eb-ab0a-8018a985d0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:13.774839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0f51-6af9-49eb-ab0a-8018a985d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:13.774839 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0f51-6af9-49eb-ab0a-8018a985d0e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:13.775441 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae0f51-6af9-49eb-ab0a-8018a985d0e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:53:13.775830 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae0f51-6af9-49eb-ab0a-8018a985d0e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:13.777533 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae0f51-6af9-49eb-ab0a-8018a985d0e9 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:13.794810 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1390/2808] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:53:13.797180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303402c-6635-4715-889e-aa98adef7eee None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:13.807739 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303402c-6635-4715-889e-aa98adef7eee None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:13.812847 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee51fd-68c9-4dfc-b222-56f101a4e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:13.813582 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee51fd-68c9-4dfc-b222-56f101a4e19e admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:13.813933 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee51fd-68c9-4dfc-b222-56f101a4e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:13.814331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee51fd-68c9-4dfc-b222-56f101a4e19e admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:13.815156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee51fd-68c9-4dfc-b222-56f101a4e19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:13.817774 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee51fd-68c9-4dfc-b222-56f101a4e19e admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:13.848753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1419/2809] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:13 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:13.853202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae0f51-6af9-49eb-ab0a-8018a985d0e9 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:13.867822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae0f51-6af9-49eb-ab0a-8018a985d0e9 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:13.875958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:13.931595 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f2963-d367-4243-a621-2dd364487661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:13.932369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f2963-d367-4243-a621-2dd364487661 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:13.932672 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f2963-d367-4243-a621-2dd364487661 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:13.932939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f2963-d367-4243-a621-2dd364487661 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:13.933599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f2963-d367-4243-a621-2dd364487661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:13.935614 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f2963-d367-4243-a621-2dd364487661 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:13.957827 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1391/2810] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:13 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:13.962672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee51fd-68c9-4dfc-b222-56f101a4e19e admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:13.973297 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee51fd-68c9-4dfc-b222-56f101a4e19e admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:13.978722 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de810b-5a8b-4031-880e-cc8e852735f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:13.979390 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de810b-5a8b-4031-880e-cc8e852735f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:13.979654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de810b-5a8b-4031-880e-cc8e852735f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:13.979929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de810b-5a8b-4031-880e-cc8e852735f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:13.980601 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de810b-5a8b-4031-880e-cc8e852735f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:13.982197 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de810b-5a8b-4031-880e-cc8e852735f6 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:13.993486 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1420/2811] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:53:13.997496 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f2963-d367-4243-a621-2dd364487661 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:14.008822 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f2963-d367-4243-a621-2dd364487661 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:14.013772 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c862b8-702a-4cfa-a604-1573a3d89298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:14.014641 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c862b8-702a-4cfa-a604-1573a3d89298 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:14.014962 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c862b8-702a-4cfa-a604-1573a3d89298 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:14.015238 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c862b8-702a-4cfa-a604-1573a3d89298 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:14.015889 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c862b8-702a-4cfa-a604-1573a3d89298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:14.017500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c862b8-702a-4cfa-a604-1573a3d89298 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:14.029632 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1392/2812] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:14.033926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de810b-5a8b-4031-880e-cc8e852735f6 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:14.045039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de810b-5a8b-4031-880e-cc8e852735f6 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:14.050028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64af3f0-0591-45f3-b097-79f7ae6e2dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:14.051021 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64af3f0-0591-45f3-b097-79f7ae6e2dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:14.051303 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64af3f0-0591-45f3-b097-79f7ae6e2dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:14.051659 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64af3f0-0591-45f3-b097-79f7ae6e2dc3 admin admin] PATH_INFO: `/v3/projects/b3900ccb8f5d4d338eedacbd61d3905f/users/4e7aa4d6b2dd431d8004df1332c9c179/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:14.070320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64af3f0-0591-45f3-b097-79f7ae6e2dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3900ccb8f5d4d338eedacbd61d3905f, user_id=4e7aa4d6b2dd431d8004df1332c9c179, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:14.073296 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64af3f0-0591-45f3-b097-79f7ae6e2dc3 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:14.088753 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1421/2813] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:14 2022] PUT /identity/v3/projects/b3900ccb8f5d4d338eedacbd61d3905f/users/4e7aa4d6b2dd431d8004df1332c9c179/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:14.093686 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0498b-42ef-4bf5-9c11-101287ea88ea None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:14.094148 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0498b-42ef-4bf5-9c11-101287ea88ea None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:14.094604 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0498b-42ef-4bf5-9c11-101287ea88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:14.116596 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-4ec0498b-42ef-4bf5-9c11-101287ea88ea None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:14.117852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4ec0498b-42ef-4bf5-9c11-101287ea88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:14.180428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1393/2814] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:14.190231 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64af3f0-0591-45f3-b097-79f7ae6e2dc3 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:14.191945 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c64af3f0-0591-45f3-b097-79f7ae6e2dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:14.211414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:14.250791 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64af3f0-0591-45f3-b097-79f7ae6e2dc3 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:14.254429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac65542-d401-4570-a581-5ecf060a6c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:14.255642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65542-d401-4570-a581-5ecf060a6c45 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:14.255917 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65542-d401-4570-a581-5ecf060a6c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:14.256188 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65542-d401-4570-a581-5ecf060a6c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:14.265280 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac65542-d401-4570-a581-5ecf060a6c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:14.266686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac65542-d401-4570-a581-5ecf060a6c45 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:14.276108 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1422/2815] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:15.963599 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0498b-42ef-4bf5-9c11-101287ea88ea None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:15.965079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-4ec0498b-42ef-4bf5-9c11-101287ea88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:15.980591 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0498b-42ef-4bf5-9c11-101287ea88ea None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:15.985870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:15.986539 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:15.986855 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:15.987135 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] PATH_INFO: `/v3/users/2660a37386e84e2fa5ab7476a9e2ebed` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:15.989971 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2660a37386e84e2fa5ab7476a9e2ebed)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:15.992021 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:16.065579 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2660a37386e84e2fa5ab7476a9e2ebed'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:16.075624 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2660a37386e84e2fa5ab7476a9e2ebed'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:16.076494 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2660a37386e84e2fa5ab7476a9e2ebed'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:16.091598 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2660a37386e84e2fa5ab7476a9e2ebed'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:16.095241 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2660a37386e84e2fa5ab7476a9e2ebed'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:16.115298 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1394/2816] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:15 2022] DELETE /identity/v3/users/2660a37386e84e2fa5ab7476a9e2ebed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:16.120677 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c644fe-b988-4c40-b932-b13773d0e819 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:16.121121 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c644fe-b988-4c40-b932-b13773d0e819 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:16.121310 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c644fe-b988-4c40-b932-b13773d0e819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:16.148656 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-64c644fe-b988-4c40-b932-b13773d0e819 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:16.149948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-64c644fe-b988-4c40-b932-b13773d0e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:16.263433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1423/2817] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:16.275225 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:16.276636 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:16.281898 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:16.368066 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29384a4-a5c2-4881-b1ac-a6260652fc00 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:16.371876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fb229-e1e0-448e-8a56-7d9b586e91c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:16.372489 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb229-e1e0-448e-8a56-7d9b586e91c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:16.372770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb229-e1e0-448e-8a56-7d9b586e91c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:16.373041 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb229-e1e0-448e-8a56-7d9b586e91c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:16.393374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fb229-e1e0-448e-8a56-7d9b586e91c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:16.396988 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fb229-e1e0-448e-8a56-7d9b586e91c9 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:16.408930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1395/2818] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:16.882342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c644fe-b988-4c40-b932-b13773d0e819 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:16.884325 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-64c644fe-b988-4c40-b932-b13773d0e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:16.905401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c644fe-b988-4c40-b932-b13773d0e819 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:16.910689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:16.912637 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:16.913022 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:16.913395 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] PATH_INFO: `/v3/projects/169f06e71eed4b2394e9bc6ab37168a5` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:16.914934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169f06e71eed4b2394e9bc6ab37168a5)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:16.918287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:17.000646 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169f06e71eed4b2394e9bc6ab37168a5', 'request_id': 'req-b4bc2ccf-bad2-44bd-9773-2557ed431016'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.010070 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169f06e71eed4b2394e9bc6ab37168a5', 'request_id': 'req-b4bc2ccf-bad2-44bd-9773-2557ed431016'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.024526 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169f06e71eed4b2394e9bc6ab37168a5', 'request_id': 'req-b4bc2ccf-bad2-44bd-9773-2557ed431016'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.039635 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] The token cache is being invalidate because project 169f06e71eed4b2394e9bc6ab37168a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:17.040001 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.040901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.043785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1424/2819] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:16 2022] DELETE /identity/v3/projects/169f06e71eed4b2394e9bc6ab37168a5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:17.051542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fb229-e1e0-448e-8a56-7d9b586e91c9 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:17.070924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fb229-e1e0-448e-8a56-7d9b586e91c9 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:17.162947 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:17.164232 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:17.164571 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:17.164856 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] PATH_INFO: `/v3/users/a9117d07b2e04e6fa2774257730b1ceb` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:17.167159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9117d07b2e04e6fa2774257730b1ceb)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:17.170744 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:17.241097 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9117d07b2e04e6fa2774257730b1ceb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.250274 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9117d07b2e04e6fa2774257730b1ceb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.251668 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9117d07b2e04e6fa2774257730b1ceb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.277932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9117d07b2e04e6fa2774257730b1ceb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.278806 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-bbafa209-7e6e-4391-a860-7bb313083201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9117d07b2e04e6fa2774257730b1ceb'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:17.302379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1396/2820] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:17 2022] DELETE /identity/v3/users/a9117d07b2e04e6fa2774257730b1ceb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:17.750290 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:17.751888 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:17.766803 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc2ccf-bad2-44bd-9773-2557ed431016 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:17.882898 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:17.943688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:17.943688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:17.943688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:17.943688 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] PATH_INFO: `/v3/projects/e60f0fe97e284dc7a09b9936e7b448d8` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:17.948333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60f0fe97e284dc7a09b9936e7b448d8)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:17.952598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:18.056111 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60f0fe97e284dc7a09b9936e7b448d8', 'request_id': 'req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:18.065039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60f0fe97e284dc7a09b9936e7b448d8', 'request_id': 'req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:18.073335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60f0fe97e284dc7a09b9936e7b448d8', 'request_id': 'req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:18.095124 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] The token cache is being invalidate because project e60f0fe97e284dc7a09b9936e7b448d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:18.095997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:18.099719 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-1c68cbb1-53fb-4b80-be29-dc0f9e659bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:18.107544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e193d26-5bb3-4cdb-bad8-ba5ff8f7af74 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:18.108042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1425/2821] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:17 2022] DELETE /identity/v3/projects/e60f0fe97e284dc7a09b9936e7b448d8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:18.108588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e193d26-5bb3-4cdb-bad8-ba5ff8f7af74 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:18.108870 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e193d26-5bb3-4cdb-bad8-ba5ff8f7af74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:18.135643 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-1e193d26-5bb3-4cdb-bad8-ba5ff8f7af74 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:18.138126 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1e193d26-5bb3-4cdb-bad8-ba5ff8f7af74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:18.167155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:18.244943 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1397/2822] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:53:18.252416 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbd34-8b40-4145-b8fa-1a3939ceb213 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:18.252823 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbd34-8b40-4145-b8fa-1a3939ceb213 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:18.253168 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbd34-8b40-4145-b8fa-1a3939ceb213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:18.283805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-fefcbd34-8b40-4145-b8fa-1a3939ceb213 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:18.285122 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-fefcbd34-8b40-4145-b8fa-1a3939ceb213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:18.302210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1426/2823] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:18.307327 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e193d26-5bb3-4cdb-bad8-ba5ff8f7af74 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:18.333768 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e193d26-5bb3-4cdb-bad8-ba5ff8f7af74 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:18.345558 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479156-9987-49fd-8acb-d8a0f7e798d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:18.347464 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479156-9987-49fd-8acb-d8a0f7e798d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:18.347941 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479156-9987-49fd-8acb-d8a0f7e798d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:18.349410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479156-9987-49fd-8acb-d8a0f7e798d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:18.351865 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67479156-9987-49fd-8acb-d8a0f7e798d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:53:18.352510 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67479156-9987-49fd-8acb-d8a0f7e798d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:18.355033 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67479156-9987-49fd-8acb-d8a0f7e798d4 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:18.376985 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1398/2824] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:53:18.379305 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbd34-8b40-4145-b8fa-1a3939ceb213 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:18.391407 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbd34-8b40-4145-b8fa-1a3939ceb213 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:18.397946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10cb7b-10e6-4723-9f9e-d34830b1cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:18.398559 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10cb7b-10e6-4723-9f9e-d34830b1cd8d admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:18.398873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10cb7b-10e6-4723-9f9e-d34830b1cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:18.399152 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10cb7b-10e6-4723-9f9e-d34830b1cd8d admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:18.399876 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10cb7b-10e6-4723-9f9e-d34830b1cd8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:18.401804 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10cb7b-10e6-4723-9f9e-d34830b1cd8d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:18.439243 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1427/2825] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:18 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:18.447242 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479156-9987-49fd-8acb-d8a0f7e798d4 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:18.465574 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479156-9987-49fd-8acb-d8a0f7e798d4 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:18.549743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03695be4-1c65-484d-ae66-b30e55849949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:18.550364 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695be4-1c65-484d-ae66-b30e55849949 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:18.550643 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695be4-1c65-484d-ae66-b30e55849949 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:18.550952 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695be4-1c65-484d-ae66-b30e55849949 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:18.552154 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03695be4-1c65-484d-ae66-b30e55849949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:18.553725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03695be4-1c65-484d-ae66-b30e55849949 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:18.591009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1399/2826] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:18 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:18.593924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10cb7b-10e6-4723-9f9e-d34830b1cd8d admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:18.606662 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10cb7b-10e6-4723-9f9e-d34830b1cd8d admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:18.612700 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddac78-f299-4e65-a59c-a18108dea9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:18.613496 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddac78-f299-4e65-a59c-a18108dea9fa admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:18.613951 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddac78-f299-4e65-a59c-a18108dea9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:18.615907 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddac78-f299-4e65-a59c-a18108dea9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:18.616577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddac78-f299-4e65-a59c-a18108dea9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:18.618255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddac78-f299-4e65-a59c-a18108dea9fa admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:18.634932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1428/2827] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:18.635311 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03695be4-1c65-484d-ae66-b30e55849949 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:18.652291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03695be4-1c65-484d-ae66-b30e55849949 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:18.665588 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e04005-ff52-4cf7-8d7d-bc4be16748cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:18.666410 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e04005-ff52-4cf7-8d7d-bc4be16748cc admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:18.666607 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e04005-ff52-4cf7-8d7d-bc4be16748cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:18.666868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e04005-ff52-4cf7-8d7d-bc4be16748cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:18.667535 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e04005-ff52-4cf7-8d7d-bc4be16748cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:18.669199 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e04005-ff52-4cf7-8d7d-bc4be16748cc admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:18.698272 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddac78-f299-4e65-a59c-a18108dea9fa admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:18.711417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1400/2828] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 11:53:18.715935 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddac78-f299-4e65-a59c-a18108dea9fa admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:18.726886 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358bbe-bfeb-4049-83f8-8744c0175cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:18.728028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358bbe-bfeb-4049-83f8-8744c0175cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:18.728028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358bbe-bfeb-4049-83f8-8744c0175cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:18.729881 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358bbe-bfeb-4049-83f8-8744c0175cb9 admin admin] PATH_INFO: `/v3/projects/a97346c3bae24a778e8c451a3100a10b/users/c0a4faaf52394a2aa020c5e0b17b27aa/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:18.774099 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6358bbe-bfeb-4049-83f8-8744c0175cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97346c3bae24a778e8c451a3100a10b, user_id=c0a4faaf52394a2aa020c5e0b17b27aa, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:18.776837 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6358bbe-bfeb-4049-83f8-8744c0175cb9 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:18.816929 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1429/2829] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:18 2022] PUT /identity/v3/projects/a97346c3bae24a778e8c451a3100a10b/users/c0a4faaf52394a2aa020c5e0b17b27aa/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:18.901555 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0846b3-06a1-4dd8-9a0f-d631ffecdb46 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:18.903168 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0846b3-06a1-4dd8-9a0f-d631ffecdb46 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:18.903468 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0846b3-06a1-4dd8-9a0f-d631ffecdb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:18.956052 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-af0846b3-06a1-4dd8-9a0f-d631ffecdb46 None None] MFA Rules not processed for user `c0a4faaf52394a2aa020c5e0b17b27aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:18.959034 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-af0846b3-06a1-4dd8-9a0f-d631ffecdb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:19.025694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24369bf-0253-4160-bf00-d31a3b6a7aca None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.026028 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24369bf-0253-4160-bf00-d31a3b6a7aca None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.026261 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24369bf-0253-4160-bf00-d31a3b6a7aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.074161 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1401/2830] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:19.075930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0846b3-06a1-4dd8-9a0f-d631ffecdb46 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.088142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-c24369bf-0253-4160-bf00-d31a3b6a7aca None None] MFA Rules not processed for user `4e7aa4d6b2dd431d8004df1332c9c179`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:19.089856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c24369bf-0253-4160-bf00-d31a3b6a7aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:19.107172 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:19.175568 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0846b3-06a1-4dd8-9a0f-d631ffecdb46 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.182520 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491fdf0-625f-43ef-a309-e140a24c7f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.183154 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:19.183312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491fdf0-625f-43ef-a309-e140a24c7f3b admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.183479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491fdf0-625f-43ef-a309-e140a24c7f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.183756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491fdf0-625f-43ef-a309-e140a24c7f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.184495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491fdf0-625f-43ef-a309-e140a24c7f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.187530 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491fdf0-625f-43ef-a309-e140a24c7f3b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.194815 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1430/2831] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:53:19.199167 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24369bf-0253-4160-bf00-d31a3b6a7aca None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.200811 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-c24369bf-0253-4160-bf00-d31a3b6a7aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:19.218927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24369bf-0253-4160-bf00-d31a3b6a7aca None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.219207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1402/2832] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:19 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:19.226549 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491fdf0-625f-43ef-a309-e140a24c7f3b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.307414 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73bf33-3846-4b98-a376-9d074718624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.308133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73bf33-3846-4b98-a376-9d074718624c admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.308328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73bf33-3846-4b98-a376-9d074718624c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.308598 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73bf33-3846-4b98-a376-9d074718624c admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.309433 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73bf33-3846-4b98-a376-9d074718624c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.311525 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73bf33-3846-4b98-a376-9d074718624c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.320333 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491fdf0-625f-43ef-a309-e140a24c7f3b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.338721 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cff12-a707-4b52-8e3e-92b320cc173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.339509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cff12-a707-4b52-8e3e-92b320cc173a admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.339793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cff12-a707-4b52-8e3e-92b320cc173a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.340058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cff12-a707-4b52-8e3e-92b320cc173a admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.340684 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cff12-a707-4b52-8e3e-92b320cc173a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.342712 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cff12-a707-4b52-8e3e-92b320cc173a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.347495 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1431/2833] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:19 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:53:19.348946 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73bf33-3846-4b98-a376-9d074718624c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.350653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9e73bf33-3846-4b98-a376-9d074718624c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:19.373847 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1403/2834] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:19 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:19.374352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cff12-a707-4b52-8e3e-92b320cc173a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.386869 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cff12-a707-4b52-8e3e-92b320cc173a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.420948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73bf33-3846-4b98-a376-9d074718624c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.427239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739df94e-7e59-4763-aa8f-d6443083e99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.428001 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739df94e-7e59-4763-aa8f-d6443083e99b service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.428233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739df94e-7e59-4763-aa8f-d6443083e99b service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.428424 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739df94e-7e59-4763-aa8f-d6443083e99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.430302 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-739df94e-7e59-4763-aa8f-d6443083e99b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:19.466544 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6b62c-00f8-45be-b315-84b84db5d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.467348 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6b62c-00f8-45be-b315-84b84db5d833 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.467635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6b62c-00f8-45be-b315-84b84db5d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.467908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6b62c-00f8-45be-b315-84b84db5d833 admin admin] PATH_INFO: `/v3/users` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.468868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6b62c-00f8-45be-b315-84b84db5d833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.471868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6b62c-00f8-45be-b315-84b84db5d833 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.511569 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1404/2835] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:19 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:19.514896 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6b62c-00f8-45be-b315-84b84db5d833 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.518253 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739df94e-7e59-4763-aa8f-d6443083e99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.521550 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739df94e-7e59-4763-aa8f-d6443083e99b service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.531169 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6b62c-00f8-45be-b315-84b84db5d833 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.532500 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1432/2836] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:19.533328 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739df94e-7e59-4763-aa8f-d6443083e99b service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.536892 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cfc58-6378-4295-8996-6b27b6dd80a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.537526 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cfc58-6378-4295-8996-6b27b6dd80a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.537808 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cfc58-6378-4295-8996-6b27b6dd80a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.538079 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cfc58-6378-4295-8996-6b27b6dd80a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.538755 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cfc58-6378-4295-8996-6b27b6dd80a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.540368 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cfc58-6378-4295-8996-6b27b6dd80a9 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.545058 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739df94e-7e59-4763-aa8f-d6443083e99b service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.554512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d8fb3-b473-4637-a029-4e19ada81d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.555603 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8fb3-b473-4637-a029-4e19ada81d19 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.556049 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8fb3-b473-4637-a029-4e19ada81d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.556489 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8fb3-b473-4637-a029-4e19ada81d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.557320 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d8fb3-b473-4637-a029-4e19ada81d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.559174 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d8fb3-b473-4637-a029-4e19ada81d19 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.560518 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1405/2837] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:19.571265 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cfc58-6378-4295-8996-6b27b6dd80a9 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.577948 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1433/2838] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:19.582135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d8fb3-b473-4637-a029-4e19ada81d19 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.582551 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cfc58-6378-4295-8996-6b27b6dd80a9 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.587733 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12d3a9-6207-4bf1-b6a5-87881a6c3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.588394 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12d3a9-6207-4bf1-b6a5-87881a6c3d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.588685 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12d3a9-6207-4bf1-b6a5-87881a6c3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.588960 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12d3a9-6207-4bf1-b6a5-87881a6c3d7b admin admin] PATH_INFO: `/v3/projects/62731b076540460c9856e4d031fc1ba1/users/031fea429d1b43718d08156d9d28c3eb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.600994 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d8fb3-b473-4637-a029-4e19ada81d19 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.603545 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:19.608400 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12d3a9-6207-4bf1-b6a5-87881a6c3d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62731b076540460c9856e4d031fc1ba1, user_id=031fea429d1b43718d08156d9d28c3eb, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.610545 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1568b-db3b-4c1f-b577-64819bd39b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.611192 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1568b-db3b-4c1f-b577-64819bd39b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.611459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1568b-db3b-4c1f-b577-64819bd39b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.611809 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1568b-db3b-4c1f-b577-64819bd39b1b admin admin] PATH_INFO: `/v3/projects/0b44e6c75a9f4426ad0bc13da17194fa/users/83a79337a65c4a3082aca22b13702699/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.612377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12d3a9-6207-4bf1-b6a5-87881a6c3d7b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.633861 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1568b-db3b-4c1f-b577-64819bd39b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b44e6c75a9f4426ad0bc13da17194fa, user_id=83a79337a65c4a3082aca22b13702699, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.635454 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1406/2839] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:19 2022] PUT /identity/v3/projects/62731b076540460c9856e4d031fc1ba1/users/031fea429d1b43718d08156d9d28c3eb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:19.636775 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1568b-db3b-4c1f-b577-64819bd39b1b admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.639802 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12d3a9-6207-4bf1-b6a5-87881a6c3d7b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.652418 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:19.661656 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1434/2840] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:19 2022] PUT /identity/v3/projects/0b44e6c75a9f4426ad0bc13da17194fa/users/83a79337a65c4a3082aca22b13702699/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:19.665610 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1568b-db3b-4c1f-b577-64819bd39b1b admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.730731 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12d3a9-6207-4bf1-b6a5-87881a6c3d7b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.753757 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1568b-db3b-4c1f-b577-64819bd39b1b admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.764388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d4443-3f9d-498e-8d8d-5789381dd1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.767362 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d4443-3f9d-498e-8d8d-5789381dd1ca admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.767645 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d4443-3f9d-498e-8d8d-5789381dd1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.767921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d4443-3f9d-498e-8d8d-5789381dd1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.768579 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d4443-3f9d-498e-8d8d-5789381dd1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.770281 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d4443-3f9d-498e-8d8d-5789381dd1ca admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.801007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1435/2841] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:19.804992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d4443-3f9d-498e-8d8d-5789381dd1ca admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.831163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d4443-3f9d-498e-8d8d-5789381dd1ca admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.837881 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae35af-401e-4f3c-bf81-1ff8a3d80f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.838657 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae35af-401e-4f3c-bf81-1ff8a3d80f70 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.839084 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae35af-401e-4f3c-bf81-1ff8a3d80f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.839452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae35af-401e-4f3c-bf81-1ff8a3d80f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.840210 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae35af-401e-4f3c-bf81-1ff8a3d80f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.841924 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae35af-401e-4f3c-bf81-1ff8a3d80f70 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.843785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eabb81-0477-48c6-bf6a-e44844c1f2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.844465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eabb81-0477-48c6-bf6a-e44844c1f2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.844747 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eabb81-0477-48c6-bf6a-e44844c1f2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.845271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eabb81-0477-48c6-bf6a-e44844c1f2f5 admin admin] PATH_INFO: `/v3/projects/0b44e6c75a9f4426ad0bc13da17194fa/users/83a79337a65c4a3082aca22b13702699/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.847270 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eabb81-0477-48c6-bf6a-e44844c1f2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b44e6c75a9f4426ad0bc13da17194fa, user_id=83a79337a65c4a3082aca22b13702699, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:19.850014 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eabb81-0477-48c6-bf6a-e44844c1f2f5 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:19.861217 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1407/2842] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:19.865621 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae35af-401e-4f3c-bf81-1ff8a3d80f70 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:19.874150 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1436/2843] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:19 2022] PUT /identity/v3/projects/0b44e6c75a9f4426ad0bc13da17194fa/users/83a79337a65c4a3082aca22b13702699/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:19.883282 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae35af-401e-4f3c-bf81-1ff8a3d80f70 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:19.987638 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a822794-295d-45e0-956a-f50558f74e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:19.989230 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a822794-295d-45e0-956a-f50558f74e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:19.989760 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a822794-295d-45e0-956a-f50558f74e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:19.990111 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a822794-295d-45e0-956a-f50558f74e98 admin admin] PATH_INFO: `/v3/projects/62731b076540460c9856e4d031fc1ba1/users/031fea429d1b43718d08156d9d28c3eb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:19.993326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a822794-295d-45e0-956a-f50558f74e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62731b076540460c9856e4d031fc1ba1, user_id=031fea429d1b43718d08156d9d28c3eb, role_id=2356e5c29e3c4ce9a64d4bd70b4615ea)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:20.010634 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a822794-295d-45e0-956a-f50558f74e98 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:20.031120 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1408/2844] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:19 2022] PUT /identity/v3/projects/62731b076540460c9856e4d031fc1ba1/users/031fea429d1b43718d08156d9d28c3eb/roles/2356e5c29e3c4ce9a64d4bd70b4615ea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:20.041421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd08281-31d7-4235-b27c-115964e9e35e None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:20.041708 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd08281-31d7-4235-b27c-115964e9e35e None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:20.041985 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd08281-31d7-4235-b27c-115964e9e35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:20.107942 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ecd08281-31d7-4235-b27c-115964e9e35e None None] MFA Rules not processed for user `031fea429d1b43718d08156d9d28c3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:20.113567 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ecd08281-31d7-4235-b27c-115964e9e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:20.247825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1437/2845] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:20.260226 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a822794-295d-45e0-956a-f50558f74e98 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:20.262895 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1a822794-295d-45e0-956a-f50558f74e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:20.326160 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:20.371415 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a822794-295d-45e0-956a-f50558f74e98 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:20.396352 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750367e-01e3-4e9d-bf1b-49057ddbb7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:20.397006 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750367e-01e3-4e9d-bf1b-49057ddbb7ac service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:20.399235 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750367e-01e3-4e9d-bf1b-49057ddbb7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:20.399728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750367e-01e3-4e9d-bf1b-49057ddbb7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:20.416479 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750367e-01e3-4e9d-bf1b-49057ddbb7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:20.417996 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750367e-01e3-4e9d-bf1b-49057ddbb7ac service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:20.432829 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1409/2846] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:20.985695 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd08281-31d7-4235-b27c-115964e9e35e None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:21.106531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd08281-31d7-4235-b27c-115964e9e35e None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:21.113969 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:21.115137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:21.115741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:21.116322 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] PATH_INFO: `/v3/users/c0a4faaf52394a2aa020c5e0b17b27aa` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:21.118577 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a4faaf52394a2aa020c5e0b17b27aa)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:21.121287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:21.130392 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:21.200458 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a4faaf52394a2aa020c5e0b17b27aa'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:21.201740 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a4faaf52394a2aa020c5e0b17b27aa'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:21.202561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a4faaf52394a2aa020c5e0b17b27aa'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:21.219744 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a4faaf52394a2aa020c5e0b17b27aa'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:21.232370 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a4faaf52394a2aa020c5e0b17b27aa'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:21.273524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1438/2847] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:20 2022] DELETE /identity/v3/users/c0a4faaf52394a2aa020c5e0b17b27aa => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:21.277635 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee232c2b-29a5-44d4-aa6c-78e4b6e58685 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:21.278173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee232c2b-29a5-44d4-aa6c-78e4b6e58685 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:21.278173 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee232c2b-29a5-44d4-aa6c-78e4b6e58685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:21.330995 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-ee232c2b-29a5-44d4-aa6c-78e4b6e58685 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:21.332930 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ee232c2b-29a5-44d4-aa6c-78e4b6e58685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:21.436315 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1410/2848] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:21.448164 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:21.449742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:21.553039 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b75f88-607d-40f1-b451-2d78d6fb0f6f admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:21.557324 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669882c-e2c4-4d64-ad2b-9537e19dfd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:21.558033 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669882c-e2c4-4d64-ad2b-9537e19dfd6b service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:21.558409 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669882c-e2c4-4d64-ad2b-9537e19dfd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:21.558751 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669882c-e2c4-4d64-ad2b-9537e19dfd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:21.572741 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669882c-e2c4-4d64-ad2b-9537e19dfd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:21.574313 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669882c-e2c4-4d64-ad2b-9537e19dfd6b service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:21.587482 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1439/2849] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:22.557783 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee232c2b-29a5-44d4-aa6c-78e4b6e58685 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:22.560997 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ee232c2b-29a5-44d4-aa6c-78e4b6e58685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:22.583792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee232c2b-29a5-44d4-aa6c-78e4b6e58685 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:22.591524 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:22.592430 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:22.592871 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:22.593319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] PATH_INFO: `/v3/projects/a97346c3bae24a778e8c451a3100a10b` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:22.595910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97346c3bae24a778e8c451a3100a10b)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:22.598256 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:22.675661 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97346c3bae24a778e8c451a3100a10b', 'request_id': 'req-49898d31-1ee6-44cc-8ec8-0857f5e6303b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:22.685495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97346c3bae24a778e8c451a3100a10b', 'request_id': 'req-49898d31-1ee6-44cc-8ec8-0857f5e6303b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:22.692746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97346c3bae24a778e8c451a3100a10b', 'request_id': 'req-49898d31-1ee6-44cc-8ec8-0857f5e6303b'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:22.712181 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] The token cache is being invalidate because project a97346c3bae24a778e8c451a3100a10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:22.712746 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:22.713805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:22.719737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1411/2850] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:22 2022] DELETE /identity/v3/projects/a97346c3bae24a778e8c451a3100a10b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:22.720914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669882c-e2c4-4d64-ad2b-9537e19dfd6b service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:22.738384 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669882c-e2c4-4d64-ad2b-9537e19dfd6b service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:22.884572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:22.885654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:22.885654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:22.885869 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] PATH_INFO: `/v3/users/031fea429d1b43718d08156d9d28c3eb` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:22.887519 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=031fea429d1b43718d08156d9d28c3eb)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:22.889428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:22.961571 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:22.996003 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031fea429d1b43718d08156d9d28c3eb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:22.997763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031fea429d1b43718d08156d9d28c3eb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:22.999156 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031fea429d1b43718d08156d9d28c3eb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:23.022873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031fea429d1b43718d08156d9d28c3eb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:23.038554 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-232743a9-0e50-4103-a2c9-5f9b63911375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031fea429d1b43718d08156d9d28c3eb'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:23.083429 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1440/2851] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:22 2022] DELETE /identity/v3/users/031fea429d1b43718d08156d9d28c3eb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:23.667796 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:23.671958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:23.696724 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49898d31-1ee6-44cc-8ec8-0857f5e6303b admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:23.823737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:23.859288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:23.862209 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:23.863484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:23.865939 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] PATH_INFO: `/v3/projects/62731b076540460c9856e4d031fc1ba1` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:23.868157 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=62731b076540460c9856e4d031fc1ba1)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:23.871485 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:23.936953 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62731b076540460c9856e4d031fc1ba1', 'request_id': 'req-ae9d044b-52f6-4d82-b747-b7cf04b104ce'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:23.946756 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62731b076540460c9856e4d031fc1ba1', 'request_id': 'req-ae9d044b-52f6-4d82-b747-b7cf04b104ce'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:23.954187 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62731b076540460c9856e4d031fc1ba1', 'request_id': 'req-ae9d044b-52f6-4d82-b747-b7cf04b104ce'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:23.968940 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] The token cache is being invalidate because project 62731b076540460c9856e4d031fc1ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:23.969239 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:23.970319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-ae9d044b-52f6-4d82-b747-b7cf04b104ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:23.976932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52540-2595-4f7b-8dd1-80d6f7efb6a7 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:23.977421 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52540-2595-4f7b-8dd1-80d6f7efb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:23.977631 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c52540-2595-4f7b-8dd1-80d6f7efb6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:23.980344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1412/2852] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:23 2022] DELETE /identity/v3/projects/62731b076540460c9856e4d031fc1ba1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:24.003849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-10c52540-2595-4f7b-8dd1-80d6f7efb6a7 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:24.007864 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-10c52540-2595-4f7b-8dd1-80d6f7efb6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:24.089493 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1441/2853] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:24.096893 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076b34-7525-495c-99ba-9db4e2ac713c None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:24.097183 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076b34-7525-495c-99ba-9db4e2ac713c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:24.097459 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076b34-7525-495c-99ba-9db4e2ac713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:24.119026 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-37076b34-7525-495c-99ba-9db4e2ac713c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:24.120272 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-37076b34-7525-495c-99ba-9db4e2ac713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:24.132861 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1413/2854] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:24.133742 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c52540-2595-4f7b-8dd1-80d6f7efb6a7 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:24.144548 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c52540-2595-4f7b-8dd1-80d6f7efb6a7 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:24.149993 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157d364-f37c-4d57-a3d4-ebf76182c0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:24.150974 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d364-f37c-4d57-a3d4-ebf76182c0ad admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:24.151484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d364-f37c-4d57-a3d4-ebf76182c0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:24.151978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d364-f37c-4d57-a3d4-ebf76182c0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:24.152850 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157d364-f37c-4d57-a3d4-ebf76182c0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88086) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:53:24.153417 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157d364-f37c-4d57-a3d4-ebf76182c0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:24.155304 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157d364-f37c-4d57-a3d4-ebf76182c0ad admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:24.173483 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37076b34-7525-495c-99ba-9db4e2ac713c None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:24.179255 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1442/2855] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 11:53:24.185054 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37076b34-7525-495c-99ba-9db4e2ac713c None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:24.190737 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a48fc-b544-4a6b-99db-5a4fc2246ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:24.192403 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a48fc-b544-4a6b-99db-5a4fc2246ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:24.192909 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a48fc-b544-4a6b-99db-5a4fc2246ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:24.193408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a48fc-b544-4a6b-99db-5a4fc2246ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:24.194309 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a48fc-b544-4a6b-99db-5a4fc2246ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:24.196612 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a48fc-b544-4a6b-99db-5a4fc2246ed6 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:24.239411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1414/2856] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:24 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:53:24.240542 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157d364-f37c-4d57-a3d4-ebf76182c0ad admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:24.252171 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157d364-f37c-4d57-a3d4-ebf76182c0ad admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:24.328828 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9ecb8-b538-49d9-9816-eff7e99a5d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:24.329578 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9ecb8-b538-49d9-9816-eff7e99a5d1f admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:24.329866 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9ecb8-b538-49d9-9816-eff7e99a5d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:24.330141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9ecb8-b538-49d9-9816-eff7e99a5d1f admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:24.331523 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9ecb8-b538-49d9-9816-eff7e99a5d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:24.334484 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9ecb8-b538-49d9-9816-eff7e99a5d1f admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:24.372925 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1443/2857] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:24 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:24.373022 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a48fc-b544-4a6b-99db-5a4fc2246ed6 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:24.389195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a48fc-b544-4a6b-99db-5a4fc2246ed6 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:24.400908 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513c84c-7dda-4189-b96a-171464675415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:24.401508 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513c84c-7dda-4189-b96a-171464675415 admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:24.401801 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513c84c-7dda-4189-b96a-171464675415 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:24.402075 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513c84c-7dda-4189-b96a-171464675415 admin admin] PATH_INFO: `/v3/roles` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:24.402728 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513c84c-7dda-4189-b96a-171464675415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:24.404378 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513c84c-7dda-4189-b96a-171464675415 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:24.424927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9ecb8-b538-49d9-9816-eff7e99a5d1f admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:24.426270 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1415/2858] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:24.439721 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9ecb8-b538-49d9-9816-eff7e99a5d1f admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:24.445932 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc81487-9b93-4a6e-aff9-c5f4bac7bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:24.446566 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc81487-9b93-4a6e-aff9-c5f4bac7bdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:24.446963 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc81487-9b93-4a6e-aff9-c5f4bac7bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:24.447788 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc81487-9b93-4a6e-aff9-c5f4bac7bdb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:24.448452 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc81487-9b93-4a6e-aff9-c5f4bac7bdb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:24.450611 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc81487-9b93-4a6e-aff9-c5f4bac7bdb1 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:24.470481 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1444/2859] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:24.474414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513c84c-7dda-4189-b96a-171464675415 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:24.491527 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513c84c-7dda-4189-b96a-171464675415 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:24.500110 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc39841-9ee7-4b3c-b488-c899186bdced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:24.501609 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc39841-9ee7-4b3c-b488-c899186bdced admin admin] REQUEST_METHOD: `PUT` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:24.502053 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc39841-9ee7-4b3c-b488-c899186bdced admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:24.502987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc39841-9ee7-4b3c-b488-c899186bdced admin admin] PATH_INFO: `/v3/projects/0f4039272bfc4aeeab8310c5f002e5a8/users/37b7e0cad11d4c8c8b4bdd7693ae5581/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:24.541500 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc39841-9ee7-4b3c-b488-c899186bdced admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4039272bfc4aeeab8310c5f002e5a8, user_id=37b7e0cad11d4c8c8b4bdd7693ae5581, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:24.545136 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc39841-9ee7-4b3c-b488-c899186bdced admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:24.574673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1416/2860] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:24 2022] PUT /identity/v3/projects/0f4039272bfc4aeeab8310c5f002e5a8/users/37b7e0cad11d4c8c8b4bdd7693ae5581/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:24.587178 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a0127-f88e-4fd2-9189-07b58af6b04a None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:24.587459 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a0127-f88e-4fd2-9189-07b58af6b04a None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:24.587738 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a0127-f88e-4fd2-9189-07b58af6b04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:24.623745 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:24.628157 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-789a0127-f88e-4fd2-9189-07b58af6b04a None None] MFA Rules not processed for user `37b7e0cad11d4c8c8b4bdd7693ae5581`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:24.630906 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-789a0127-f88e-4fd2-9189-07b58af6b04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:24.749208 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1445/2861] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:24.762914 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc39841-9ee7-4b3c-b488-c899186bdced admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:24.765897 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ffc39841-9ee7-4b3c-b488-c899186bdced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:24.847964 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc39841-9ee7-4b3c-b488-c899186bdced admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:24.858748 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2cfe8-18e5-4dbc-8fa0-1e70d5013c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:24.858748 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2cfe8-18e5-4dbc-8fa0-1e70d5013c9d service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:24.858748 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2cfe8-18e5-4dbc-8fa0-1e70d5013c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:24.858748 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2cfe8-18e5-4dbc-8fa0-1e70d5013c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:24.866351 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2cfe8-18e5-4dbc-8fa0-1e70d5013c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:24.868159 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2cfe8-18e5-4dbc-8fa0-1e70d5013c9d service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:24.883907 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1417/2862] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:26.329254 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46714b2-7142-46da-ab14-707dfd35660b None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:26.329921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46714b2-7142-46da-ab14-707dfd35660b None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:26.329921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46714b2-7142-46da-ab14-707dfd35660b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:26.367998 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-a46714b2-7142-46da-ab14-707dfd35660b None None] MFA Rules not processed for user `83a79337a65c4a3082aca22b13702699`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:26.369887 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a46714b2-7142-46da-ab14-707dfd35660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:26.457914 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1446/2863] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:53:26.471140 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2cfe8-18e5-4dbc-8fa0-1e70d5013c9d service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:26.473184 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-45b2cfe8-18e5-4dbc-8fa0-1e70d5013c9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:26.523008 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:26.563145 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2cfe8-18e5-4dbc-8fa0-1e70d5013c9d service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:26.573951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3bd33cac7d4715bede59def04cdb92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:26.573951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:26.573951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:26.573951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:26.574936 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:26.652016 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:26.653465 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:26.663717 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1418/2864] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:26.786806 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca139d-37f8-4996-9a5a-49b9f3446226 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:26.787093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca139d-37f8-4996-9a5a-49b9f3446226 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:26.787369 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca139d-37f8-4996-9a5a-49b9f3446226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:26.807360 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9bca139d-37f8-4996-9a5a-49b9f3446226 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:26.808591 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9bca139d-37f8-4996-9a5a-49b9f3446226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:26.868182 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1447/2865] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:53:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:26.881289 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:26.882663 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:26.961250 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f1fc3-af69-4285-8627-d1b513735a35 service glance] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:26.966275 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d8e57-8fbd-446c-9eba-6aa0edab99de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:26.966916 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d8e57-8fbd-446c-9eba-6aa0edab99de service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:26.967202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d8e57-8fbd-446c-9eba-6aa0edab99de service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:26.967473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d8e57-8fbd-446c-9eba-6aa0edab99de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:26.976437 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d8e57-8fbd-446c-9eba-6aa0edab99de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:26.978039 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d8e57-8fbd-446c-9eba-6aa0edab99de service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:26.986257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1419/2866] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:53:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:53:35.964860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d72a2-8696-4809-8f27-2f02586a7b06 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:35.965427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d72a2-8696-4809-8f27-2f02586a7b06 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:35.965427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d72a2-8696-4809-8f27-2f02586a7b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:35.990934 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-947d72a2-8696-4809-8f27-2f02586a7b06 None None] MFA Rules not processed for user `4e7aa4d6b2dd431d8004df1332c9c179`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:35.992180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-947d72a2-8696-4809-8f27-2f02586a7b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:35.999142 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1448/2867] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:36.982906 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=70 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:37.130797 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d8e57-8fbd-446c-9eba-6aa0edab99de service swift] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:37.196622 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d8e57-8fbd-446c-9eba-6aa0edab99de service swift] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:37.201308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:37.201965 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:37.202260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:37.202553 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] PATH_INFO: `/v3/users/37b7e0cad11d4c8c8b4bdd7693ae5581` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:37.203789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b7e0cad11d4c8c8b4bdd7693ae5581)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:37.205836 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:37.255664 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b7e0cad11d4c8c8b4bdd7693ae5581'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.262589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b7e0cad11d4c8c8b4bdd7693ae5581'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.263288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b7e0cad11d4c8c8b4bdd7693ae5581'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.276484 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b7e0cad11d4c8c8b4bdd7693ae5581'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.277204 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b7e0cad11d4c8c8b4bdd7693ae5581'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.295511 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1420/2868] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:53:37 2022] DELETE /identity/v3/users/37b7e0cad11d4c8c8b4bdd7693ae5581 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:37.297349 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1292ba-59c6-4bd7-be81-ac97f8142a66 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:37.297845 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1292ba-59c6-4bd7-be81-ac97f8142a66 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:37.297974 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1292ba-59c6-4bd7-be81-ac97f8142a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:37.319465 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-6f1292ba-59c6-4bd7-be81-ac97f8142a66 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:37.320853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6f1292ba-59c6-4bd7-be81-ac97f8142a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:37.345087 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:37.390660 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1449/2869] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:37.401735 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:37.403249 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:37.470586 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a13f3-e67f-4f43-ba5b-53932ae4f05c admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:37.475278 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b6436-2295-4ef1-a147-b24aedabe358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:37.475890 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b6436-2295-4ef1-a147-b24aedabe358 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:37.476435 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b6436-2295-4ef1-a147-b24aedabe358 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:37.476720 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b6436-2295-4ef1-a147-b24aedabe358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:37.487460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b6436-2295-4ef1-a147-b24aedabe358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:37.489473 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b6436-2295-4ef1-a147-b24aedabe358 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:37.500509 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1421/2870] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:37.795873 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1292ba-59c6-4bd7-be81-ac97f8142a66 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:37.798129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-6f1292ba-59c6-4bd7-be81-ac97f8142a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:37.814821 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1292ba-59c6-4bd7-be81-ac97f8142a66 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:37.821604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:37.823335 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:37.823896 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:37.824382 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] PATH_INFO: `/v3/projects/0f4039272bfc4aeeab8310c5f002e5a8` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:37.825905 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4039272bfc4aeeab8310c5f002e5a8)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:37.828141 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:37.905609 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4039272bfc4aeeab8310c5f002e5a8', 'request_id': 'req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.916512 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4039272bfc4aeeab8310c5f002e5a8', 'request_id': 'req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.923884 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4039272bfc4aeeab8310c5f002e5a8', 'request_id': 'req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.947245 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] The token cache is being invalidate because project 0f4039272bfc4aeeab8310c5f002e5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:53:37.947831 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.954979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-dd5bf8c3-d6bf-4b71-b1d3-94a3675214e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:53:37.957723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1450/2871] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:53:37 2022] DELETE /identity/v3/projects/0f4039272bfc4aeeab8310c5f002e5a8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:53:37.963910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a857e2-e9bb-4278-92b9-2365dfe9f40b None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:37.963910 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a857e2-e9bb-4278-92b9-2365dfe9f40b None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:37.964499 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a857e2-e9bb-4278-92b9-2365dfe9f40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:37.996009 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-f8a857e2-e9bb-4278-92b9-2365dfe9f40b None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:37.999834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-f8a857e2-e9bb-4278-92b9-2365dfe9f40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:38.029056 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:38.091417 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1422/2872] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:38.099918 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924956fc-6da0-47e2-9377-dde76d9dfde4 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.100239 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924956fc-6da0-47e2-9377-dde76d9dfde4 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.100561 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924956fc-6da0-47e2-9377-dde76d9dfde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.121693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-924956fc-6da0-47e2-9377-dde76d9dfde4 None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:38.123257 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-924956fc-6da0-47e2-9377-dde76d9dfde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:38.136287 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1451/2873] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:38.142700 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a857e2-e9bb-4278-92b9-2365dfe9f40b None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:38.156219 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a857e2-e9bb-4278-92b9-2365dfe9f40b None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:38.162951 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a07338-3963-47ef-ae0c-5bb2b01db33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:38.163743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a07338-3963-47ef-ae0c-5bb2b01db33c admin admin] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.164001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a07338-3963-47ef-ae0c-5bb2b01db33c admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.164287 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a07338-3963-47ef-ae0c-5bb2b01db33c admin admin] PATH_INFO: `/v3/domains` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.164946 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a07338-3963-47ef-ae0c-5bb2b01db33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 11:53:38.165260 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a07338-3963-47ef-ae0c-5bb2b01db33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:38.167195 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a07338-3963-47ef-ae0c-5bb2b01db33c admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:38.182640 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1423/2874] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 11:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 11:53:38.188089 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924956fc-6da0-47e2-9377-dde76d9dfde4 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:38.197932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94604e6f-bd47-43a5-b5cb-45c5e58bb6d8 None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.198288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94604e6f-bd47-43a5-b5cb-45c5e58bb6d8 None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.198564 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94604e6f-bd47-43a5-b5cb-45c5e58bb6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.201718 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924956fc-6da0-47e2-9377-dde76d9dfde4 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:38.208229 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55a21-333a-485b-9ec4-12e18b45c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:38.208528 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55a21-333a-485b-9ec4-12e18b45c457 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.208697 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55a21-333a-485b-9ec4-12e18b45c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.208838 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55a21-333a-485b-9ec4-12e18b45c457 admin admin] PATH_INFO: `/v3/projects` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.209470 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf55a21-333a-485b-9ec4-12e18b45c457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:38.211449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf55a21-333a-485b-9ec4-12e18b45c457 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:38.219597 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-94604e6f-bd47-43a5-b5cb-45c5e58bb6d8 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:38.220935 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-94604e6f-bd47-43a5-b5cb-45c5e58bb6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:38.251860 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1452/2875] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 11:53:38 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 11:53:38.256540 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55a21-333a-485b-9ec4-12e18b45c457 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:38.302673 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1424/2876] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 11:53:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:38.315505 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94604e6f-bd47-43a5-b5cb-45c5e58bb6d8 None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:38.319246 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-94604e6f-bd47-43a5-b5cb-45c5e58bb6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:38.343587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55a21-333a-485b-9ec4-12e18b45c457 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:38.351474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbf93b-21c7-41c0-9d25-877314cefa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:38.351474 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbf93b-21c7-41c0-9d25-877314cefa68 admin admin] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.351924 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbf93b-21c7-41c0-9d25-877314cefa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.352079 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbf93b-21c7-41c0-9d25-877314cefa68 admin admin] PATH_INFO: `/v3/users` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.352901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbf93b-21c7-41c0-9d25-877314cefa68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:38.354732 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbf93b-21c7-41c0-9d25-877314cefa68 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:38.384517 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1453/2877] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 11:53:38 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 11:53:38.389546 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbf93b-21c7-41c0-9d25-877314cefa68 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:38.401029 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbf93b-21c7-41c0-9d25-877314cefa68 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:38.406340 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d9ee2-5e2e-4410-b84f-efe29587f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:38.407333 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d9ee2-5e2e-4410-b84f-efe29587f47c admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.407532 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d9ee2-5e2e-4410-b84f-efe29587f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.407863 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d9ee2-5e2e-4410-b84f-efe29587f47c admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.408585 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d9ee2-5e2e-4410-b84f-efe29587f47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:38.411104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d9ee2-5e2e-4410-b84f-efe29587f47c admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:38.417323 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:38.427653 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1454/2878] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:38.430622 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d9ee2-5e2e-4410-b84f-efe29587f47c admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:38.435630 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94604e6f-bd47-43a5-b5cb-45c5e58bb6d8 None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:38.446135 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d9ee2-5e2e-4410-b84f-efe29587f47c admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:38.453144 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8e75-89f1-47d3-9136-ed7ad843b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:38.453769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8e75-89f1-47d3-9136-ed7ad843b1fe admin admin] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.454054 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8e75-89f1-47d3-9136-ed7ad843b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.454331 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8e75-89f1-47d3-9136-ed7ad843b1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.455013 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff8e75-89f1-47d3-9136-ed7ad843b1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:38.456694 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff8e75-89f1-47d3-9136-ed7ad843b1fe admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:38.471494 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1455/2879] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 11:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 11:53:38.477275 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8e75-89f1-47d3-9136-ed7ad843b1fe admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:38.493943 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8e75-89f1-47d3-9136-ed7ad843b1fe admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:38.501794 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b4e70-0b86-4910-958d-ad18165ca349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:38.502789 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b4e70-0b86-4910-958d-ad18165ca349 admin admin] REQUEST_METHOD: `PUT` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.503196 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b4e70-0b86-4910-958d-ad18165ca349 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.503413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b4e70-0b86-4910-958d-ad18165ca349 admin admin] PATH_INFO: `/v3/projects/722023d5c19945f5a5e937098e5a6141/users/cf0426421d5e4142b87f006427117957/roles/2d6cbe50524e4807bb6ab829cef3525c` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.508676 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:38.527104 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b4e70-0b86-4910-958d-ad18165ca349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722023d5c19945f5a5e937098e5a6141, user_id=cf0426421d5e4142b87f006427117957, role_id=2d6cbe50524e4807bb6ab829cef3525c)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:38.527373 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b79793-5f28-4811-b691-c063e8ef2e82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:38.527769 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b79793-5f28-4811-b691-c063e8ef2e82 service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.528051 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b79793-5f28-4811-b691-c063e8ef2e82 service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.528319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b79793-5f28-4811-b691-c063e8ef2e82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.529784 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b4e70-0b86-4910-958d-ad18165ca349 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:38.548926 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1456/2880] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 11:53:38 2022] PUT /identity/v3/projects/722023d5c19945f5a5e937098e5a6141/users/cf0426421d5e4142b87f006427117957/roles/2d6cbe50524e4807bb6ab829cef3525c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:53:38.562675 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f289-24de-4592-bec7-e5286c0671de None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:38.563454 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f289-24de-4592-bec7-e5286c0671de None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:38.563846 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f289-24de-4592-bec7-e5286c0671de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:38.597419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-aa28f289-24de-4592-bec7-e5286c0671de None None] MFA Rules not processed for user `cf0426421d5e4142b87f006427117957`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:53:38.599672 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-aa28f289-24de-4592-bec7-e5286c0671de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:38.617957 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b79793-5f28-4811-b691-c063e8ef2e82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:38.619876 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b79793-5f28-4811-b691-c063e8ef2e82 service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:38.634117 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1425/2881] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:53:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 11:53:38.716587 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1457/2882] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:53:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:53:38.739237 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b79793-5f28-4811-b691-c063e8ef2e82 service swift] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:53:38.740779 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-91b79793-5f28-4811-b691-c063e8ef2e82 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:53:38.884584 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b79793-5f28-4811-b691-c063e8ef2e82 service swift] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:53:39.002901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee870d89-6cbf-4f01-a5f5-925b93cf674e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580a07e04f3e42a5bb2801e583a78a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:53:39.004828 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee870d89-6cbf-4f01-a5f5-925b93cf674e service cinder] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:53:39.005319 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee870d89-6cbf-4f01-a5f5-925b93cf674e service cinder] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:53:39.005774 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee870d89-6cbf-4f01-a5f5-925b93cf674e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:53:39.033503 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee870d89-6cbf-4f01-a5f5-925b93cf674e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:53:39.035449 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee870d89-6cbf-4f01-a5f5-925b93cf674e service cinder] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:53:39.059825 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1426/2883] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:53:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:53:48.710978 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:53:49.043495 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=74 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:54:00.147291 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f289-24de-4592-bec7-e5286c0671de None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:54:00.148763 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-aa28f289-24de-4592-bec7-e5286c0671de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:54:00.247927 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f289-24de-4592-bec7-e5286c0671de None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:54:00.251980 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389d175-17e8-4043-85ed-fb947eb68309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:54:00.253464 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389d175-17e8-4043-85ed-fb947eb68309 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:54:00.253621 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389d175-17e8-4043-85ed-fb947eb68309 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:54:00.253805 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389d175-17e8-4043-85ed-fb947eb68309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:54:00.255690 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9389d175-17e8-4043-85ed-fb947eb68309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:54:00.352045 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389d175-17e8-4043-85ed-fb947eb68309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:54:00.353401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389d175-17e8-4043-85ed-fb947eb68309 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:54:00.363172 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1458/2884] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:54:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:54:00.770792 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee870d89-6cbf-4f01-a5f5-925b93cf674e service cinder] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:54:00.772291 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-ee870d89-6cbf-4f01-a5f5-925b93cf674e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:54:00.931961 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee870d89-6cbf-4f01-a5f5-925b93cf674e service cinder] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:54:00.939389 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13133752-9ad3-4080-b4f0-d84746871adf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:54:00.939882 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133752-9ad3-4080-b4f0-d84746871adf service placement] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:54:00.940069 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133752-9ad3-4080-b4f0-d84746871adf service placement] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:54:00.940344 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133752-9ad3-4080-b4f0-d84746871adf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:54:00.947043 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-13133752-9ad3-4080-b4f0-d84746871adf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:54:00.962349 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13133752-9ad3-4080-b4f0-d84746871adf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:54:00.964003 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13133752-9ad3-4080-b4f0-d84746871adf service placement] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:54:00.977790 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1427/2885] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:54:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:54:10.358825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=72 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:54:10.756901 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389d175-17e8-4043-85ed-fb947eb68309 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:54:10.841818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389d175-17e8-4043-85ed-fb947eb68309 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:54:10.848200 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:54:10.848840 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:54:10.849123 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:54:10.849401 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] PATH_INFO: `/v3/users/cf0426421d5e4142b87f006427117957` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:54:10.850604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf0426421d5e4142b87f006427117957)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:54:10.852564 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:54:10.903785 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf0426421d5e4142b87f006427117957'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:10.904448 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf0426421d5e4142b87f006427117957'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:10.905061 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf0426421d5e4142b87f006427117957'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:10.914005 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf0426421d5e4142b87f006427117957'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:10.922839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf0426421d5e4142b87f006427117957'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:10.944858 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1459/2886] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:54:10 2022] DELETE /identity/v3/users/cf0426421d5e4142b87f006427117957 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:54:10.949411 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e75f-2bc7-4b33-a1e1-2a4fa61b2a1c None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:54:10.949852 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e75f-2bc7-4b33-a1e1-2a4fa61b2a1c None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:54:10.950102 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e75f-2bc7-4b33-a1e1-2a4fa61b2a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:54:10.991578 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-b6e7e75f-2bc7-4b33-a1e1-2a4fa61b2a1c None None] MFA Rules not processed for user `6889fd2ecc6c467f8af1a4d5c4e42fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:54:10.992718 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b6e7e75f-2bc7-4b33-a1e1-2a4fa61b2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:54:11.055155 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1428/2887] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 11:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 11:54:11.066137 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:54:11.067573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:54:11.137921 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:54:11.150180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c3c5-ea66-4c25-a04a-02c5f40d27cd admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:54:11.154093 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf0c95-a9ca-4441-a9fe-1d96d7e2023a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:54:11.154706 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0c95-a9ca-4441-a9fe-1d96d7e2023a service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:54:11.155017 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0c95-a9ca-4441-a9fe-1d96d7e2023a service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:54:11.155294 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0c95-a9ca-4441-a9fe-1d96d7e2023a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:54:11.164689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf0c95-a9ca-4441-a9fe-1d96d7e2023a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:54:11.166202 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf0c95-a9ca-4441-a9fe-1d96d7e2023a service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:54:11.175997 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1460/2888] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:54:11.454736 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7e75f-2bc7-4b33-a1e1-2a4fa61b2a1c None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:54:11.456472 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b6e7e75f-2bc7-4b33-a1e1-2a4fa61b2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:54:11.471606 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7e75f-2bc7-4b33-a1e1-2a4fa61b2a1c None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:54:11.478018 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:54:11.478653 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:54:11.478962 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:54:11.479374 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] PATH_INFO: `/v3/projects/722023d5c19945f5a5e937098e5a6141` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:54:11.480480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] RBAC: Authorizing `identity:delete_project(project_id=722023d5c19945f5a5e937098e5a6141)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:54:11.482288 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:54:11.499433 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:54:11.535436 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722023d5c19945f5a5e937098e5a6141', 'request_id': 'req-18f92b30-e26f-4675-b80b-7c93dba5420d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:11.544067 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722023d5c19945f5a5e937098e5a6141', 'request_id': 'req-18f92b30-e26f-4675-b80b-7c93dba5420d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:11.551408 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722023d5c19945f5a5e937098e5a6141', 'request_id': 'req-18f92b30-e26f-4675-b80b-7c93dba5420d'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:11.562455 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] The token cache is being invalidate because project 722023d5c19945f5a5e937098e5a6141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:54:11.562743 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:11.563426 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-18f92b30-e26f-4675-b80b-7c93dba5420d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:54:11.565542 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1429/2889] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:54:11 2022] DELETE /identity/v3/projects/722023d5c19945f5a5e937098e5a6141 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:54:21.171326 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=7 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:54:21.559817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:55:32.319583 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f6e1-c2be-4e35-8cf6-f82749bcb798 None None] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:32.320145 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f6e1-c2be-4e35-8cf6-f82749bcb798 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:32.320385 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f6e1-c2be-4e35-8cf6-f82749bcb798 None None] PATH_INFO: `/` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:32.322419 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1461/2890] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:55:32.330377 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a4de4-f502-4913-9cdf-f4e33880eedb None None] REQUEST_METHOD: `POST` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:32.330958 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a4de4-f502-4913-9cdf-f4e33880eedb None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:32.331071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a4de4-f502-4913-9cdf-f4e33880eedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:32.377784 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.auth.core [None req-9c3a4de4-f502-4913-9cdf-f4e33880eedb None None] MFA Rules not processed for user `9b072d5669e34ad5b7b52a4a6e26700b`. Rule list: `[]` (Enabled: `True`). {{(pid=88085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:55:32.379165 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-9c3a4de4-f502-4913-9cdf-f4e33880eedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:32.441074 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1430/2891] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:55:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:55:32.455289 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f6e1-c2be-4e35-8cf6-f82749bcb798 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:55:32.460225 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-a450f6e1-c2be-4e35-8cf6-f82749bcb798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:32.474531 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f6e1-c2be-4e35-8cf6-f82749bcb798 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:55:32.478133 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37dcc5-8f75-4357-8f20-60f0e21b4a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:55:32.478756 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37dcc5-8f75-4357-8f20-60f0e21b4a7f service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:32.479062 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37dcc5-8f75-4357-8f20-60f0e21b4a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:32.479332 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37dcc5-8f75-4357-8f20-60f0e21b4a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:32.487607 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37dcc5-8f75-4357-8f20-60f0e21b4a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:55:32.489856 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37dcc5-8f75-4357-8f20-60f0e21b4a7f service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:55:32.497702 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1462/2892] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:55:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:55:33.599005 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bbe51-6f86-4c12-a520-d0741284263d None None] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:33.599541 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bbe51-6f86-4c12-a520-d0741284263d None None] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:33.599920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bbe51-6f86-4c12-a520-d0741284263d None None] PATH_INFO: `/` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:33.601296 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1431/2893] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 11:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:55:33.607292 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa92d80-7b71-41de-a35f-a408b5bd1b17 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:33.607715 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa92d80-7b71-41de-a35f-a408b5bd1b17 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:33.607849 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa92d80-7b71-41de-a35f-a408b5bd1b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:33.647210 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-9aa92d80-7b71-41de-a35f-a408b5bd1b17 None None] MFA Rules not processed for user `46e2fac1066d4ad7b670d46f158fec97`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:55:33.648444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-9aa92d80-7b71-41de-a35f-a408b5bd1b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:33.756321 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1463/2894] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 11:55:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:55:33.768875 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bbe51-6f86-4c12-a520-d0741284263d None None] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:55:33.780534 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bbe51-6f86-4c12-a520-d0741284263d None None] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:55:33.784192 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896673b-fcb4-4b8d-ba16-420693edf4cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:55:33.784787 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896673b-fcb4-4b8d-ba16-420693edf4cf service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:33.785058 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896673b-fcb4-4b8d-ba16-420693edf4cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:33.785325 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896673b-fcb4-4b8d-ba16-420693edf4cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:33.796533 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896673b-fcb4-4b8d-ba16-420693edf4cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:55:33.798082 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896673b-fcb4-4b8d-ba16-420693edf4cf service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:55:33.809150 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1432/2895] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:55:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:55:37.412879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7421e-a14c-4a6c-82e1-5d07e2bede89 None None] REQUEST_METHOD: `POST` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:37.413345 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7421e-a14c-4a6c-82e1-5d07e2bede89 None None] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:37.413461 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7421e-a14c-4a6c-82e1-5d07e2bede89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:37.433263 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.auth.core [None req-ccd7421e-a14c-4a6c-82e1-5d07e2bede89 None None] MFA Rules not processed for user `1e97f5a53a9248438740d138d69596dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88086) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:55:37.434617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ccd7421e-a14c-4a6c-82e1-5d07e2bede89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:37.492265 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1464/2896] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 11:55:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:55:37.536316 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896673b-fcb4-4b8d-ba16-420693edf4cf service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:55:37.538061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-1896673b-fcb4-4b8d-ba16-420693edf4cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:37.635480 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896673b-fcb4-4b8d-ba16-420693edf4cf service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:55:37.641371 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29453f9-ce0e-4b51-a1f8-b547ee527db6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81a9aefdc6c4ada9baca8097927c03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:55:37.641670 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29453f9-ce0e-4b51-a1f8-b547ee527db6 service swift] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:37.641932 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29453f9-ce0e-4b51-a1f8-b547ee527db6 service swift] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:37.642204 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29453f9-ce0e-4b51-a1f8-b547ee527db6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:37.651317 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29453f9-ce0e-4b51-a1f8-b547ee527db6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:55:37.652950 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29453f9-ce0e-4b51-a1f8-b547ee527db6 service swift] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:55:37.661529 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1433/2897] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 11:55:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 11:55:44.734453 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7421e-a14c-4a6c-82e1-5d07e2bede89 None None] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:55:44.738801 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-ccd7421e-a14c-4a6c-82e1-5d07e2bede89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:44.812639 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=100 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:55:44.821428 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29453f9-ce0e-4b51-a1f8-b547ee527db6 service swift] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:55:44.822900 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-e29453f9-ce0e-4b51-a1f8-b547ee527db6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:44.835388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7421e-a14c-4a6c-82e1-5d07e2bede89 None None] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:55:44.842207 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b225f-573a-411b-bf47-f81e25652df3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:55:44.843916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b225f-573a-411b-bf47-f81e25652df3 service placement] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:44.844198 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b225f-573a-411b-bf47-f81e25652df3 service placement] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:44.844475 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b225f-573a-411b-bf47-f81e25652df3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:44.847279 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-de7b225f-573a-411b-bf47-f81e25652df3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:44.867853 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b225f-573a-411b-bf47-f81e25652df3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:55:44.869572 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b225f-573a-411b-bf47-f81e25652df3 service placement] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:55:44.886604 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1465/2898] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:55:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:55:44.922414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29453f9-ce0e-4b51-a1f8-b547ee527db6 service swift] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:55:44.927379 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:55:44.928269 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:44.928765 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:44.929207 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] PATH_INFO: `/v3/users/4e7aa4d6b2dd431d8004df1332c9c179` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:44.932130 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7aa4d6b2dd431d8004df1332c9c179)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:55:44.934304 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:55:44.951570 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=100 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:55:45.004312 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7aa4d6b2dd431d8004df1332c9c179'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.017540 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7aa4d6b2dd431d8004df1332c9c179'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.019164 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7aa4d6b2dd431d8004df1332c9c179'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.041001 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7aa4d6b2dd431d8004df1332c9c179'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.041777 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7aa4d6b2dd431d8004df1332c9c179'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.068837 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1434/2899] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:55:44 2022] DELETE /identity/v3/users/4e7aa4d6b2dd431d8004df1332c9c179 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:55:45.259521 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b225f-573a-411b-bf47-f81e25652df3 service placement] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:55:45.270617 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b225f-573a-411b-bf47-f81e25652df3 service placement] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:55:45.331457 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:55:45.332042 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:45.332351 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:45.332627 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] PATH_INFO: `/v3/projects/b3900ccb8f5d4d338eedacbd61d3905f` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:45.333911 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3900ccb8f5d4d338eedacbd61d3905f)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:55:45.336066 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:55:45.386080 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3900ccb8f5d4d338eedacbd61d3905f', 'request_id': 'req-e7b6730d-ca7c-4497-85d5-b01db5baafba'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.393110 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3900ccb8f5d4d338eedacbd61d3905f', 'request_id': 'req-e7b6730d-ca7c-4497-85d5-b01db5baafba'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.398686 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3900ccb8f5d4d338eedacbd61d3905f', 'request_id': 'req-e7b6730d-ca7c-4497-85d5-b01db5baafba'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.412090 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] The token cache is being invalidate because project b3900ccb8f5d4d338eedacbd61d3905f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:55:45.412383 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.413007 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.414518 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1466/2900] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:55:45 2022] DELETE /identity/v3/projects/b3900ccb8f5d4d338eedacbd61d3905f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:55:45.418577 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:55:45.420036 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:45.433877 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a6096-9c1f-4955-aec2-4fe63134d53a admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:55:45.490463 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:55:45.491129 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:45.491413 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:45.491689 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] PATH_INFO: `/v3/users/83a79337a65c4a3082aca22b13702699` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:45.492805 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a79337a65c4a3082aca22b13702699)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:55:45.494711 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:55:45.542705 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a79337a65c4a3082aca22b13702699'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.550244 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a79337a65c4a3082aca22b13702699'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.551031 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a79337a65c4a3082aca22b13702699'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.566671 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a79337a65c4a3082aca22b13702699'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.567444 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a79337a65c4a3082aca22b13702699'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.581987 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1435/2901] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:55:45 2022] DELETE /identity/v3/users/83a79337a65c4a3082aca22b13702699 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:55:45.771057 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:55:45.772573 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:55:45.786147 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6730d-ca7c-4497-85d5-b01db5baafba admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:55:45.853590 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:55:45.854342 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:55:45.854698 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:55:45.855060 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] PATH_INFO: `/v3/projects/0b44e6c75a9f4426ad0bc13da17194fa` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:55:45.856444 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b44e6c75a9f4426ad0bc13da17194fa)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:55:45.858962 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:55:45.883180 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:55:45.913552 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b44e6c75a9f4426ad0bc13da17194fa', 'request_id': 'req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.921129 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b44e6c75a9f4426ad0bc13da17194fa', 'request_id': 'req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.931065 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b44e6c75a9f4426ad0bc13da17194fa', 'request_id': 'req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.946632 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] The token cache is being invalidate because project 0b44e6c75a9f4426ad0bc13da17194fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:55:45.946992 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.947680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:55:45.949389 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1467/2902] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:55:45 2022] DELETE /identity/v3/projects/0b44e6c75a9f4426ad0bc13da17194fa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:55:55.578326 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:DELETE=20,keystone:SELECT=75,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:55:55.943139 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:57:02.115061 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:57:02.117373 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:02.211085 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c184be-d092-48fc-906c-db87d39d71f3 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:57:02.310680 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:57:02.312201 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:02.317366 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2fac1066d4ad7b670d46f158fec97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:57:02.318460 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:57:02.319108 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:57:02.319452 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:57:02.321414 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:02.338252 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:57:02.339905 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:57:02.354396 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1436/2903] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:57:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:57:02.383678 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e8b4b-3fa8-4cde-8bf7-2cf012c8fd7d admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:57:02.389642 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f8aa2-da82-4409-81e5-d36161ad28c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:57:02.390839 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f8aa2-da82-4409-81e5-d36161ad28c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:57:02.391134 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f8aa2-da82-4409-81e5-d36161ad28c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:57:02.391413 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f8aa2-da82-4409-81e5-d36161ad28c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:57:02.393388 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-349f8aa2-da82-4409-81e5-d36161ad28c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:02.408094 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f8aa2-da82-4409-81e5-d36161ad28c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:57:02.409524 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f8aa2-da82-4409-81e5-d36161ad28c2 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:57:02.422483 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1468/2904] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:57:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:57:03.537770 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:57:03.539257 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:03.551223 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55f1cb-006b-4522-9754-060c06173f46 service nova] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:57:03.554817 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:57:03.555420 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:57:03.555701 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:57:03.555972 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:57:03.557725 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:03.568984 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:57:03.570456 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:57:03.579679 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1437/2905] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:57:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:57:03.609693 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f8aa2-da82-4409-81e5-d36161ad28c2 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:57:03.618499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f8aa2-da82-4409-81e5-d36161ad28c2 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:57:03.626492 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd99e6c-3d1b-4eb5-8095-f93990634ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b072d5669e34ad5b7b52a4a6e26700b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:57:03.627216 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99e6c-3d1b-4eb5-8095-f93990634ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:57:03.627499 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99e6c-3d1b-4eb5-8095-f93990634ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:57:03.627782 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99e6c-3d1b-4eb5-8095-f93990634ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:57:03.629746 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-1bd99e6c-3d1b-4eb5-8095-f93990634ba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:03.644852 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd99e6c-3d1b-4eb5-8095-f93990634ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:57:03.646271 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd99e6c-3d1b-4eb5-8095-f93990634ba7 service neutron] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:57:03.659916 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1469/2906] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:57:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:57:12.361803 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:57:12.363338 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:12.442119 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e66d16-b099-4a22-b1ab-6b30145922c2 service neutron] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:57:12.446954 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:57:12.447589 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:57:12.447874 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:57:12.448156 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] PATH_INFO: `/v3/users/f111f756f37c45e1b575ba2da90311f7` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:57:12.449335 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f111f756f37c45e1b575ba2da90311f7)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:57:12.452330 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:57:12.465357 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:57:12.500813 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f111f756f37c45e1b575ba2da90311f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.507642 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f111f756f37c45e1b575ba2da90311f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.508308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f111f756f37c45e1b575ba2da90311f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.521866 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f111f756f37c45e1b575ba2da90311f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.522793 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f111f756f37c45e1b575ba2da90311f7'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.539072 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1438/2907] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:57:12 2022] DELETE /identity/v3/users/f111f756f37c45e1b575ba2da90311f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:57:12.711434 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd99e6c-3d1b-4eb5-8095-f93990634ba7 service neutron] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:57:12.722802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd99e6c-3d1b-4eb5-8095-f93990634ba7 service neutron] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:57:12.781503 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:57:12.782163 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:57:12.782449 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:57:12.782726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] PATH_INFO: `/v3/projects/d0f280fea36f4e1e860e489d34aee70d` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:57:12.783879 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f280fea36f4e1e860e489d34aee70d)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:57:12.785825 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:57:12.838153 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f280fea36f4e1e860e489d34aee70d', 'request_id': 'req-5d7e90f3-ad5c-45f3-be4f-3067b674de57'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.844769 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f280fea36f4e1e860e489d34aee70d', 'request_id': 'req-5d7e90f3-ad5c-45f3-be4f-3067b674de57'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.850213 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f280fea36f4e1e860e489d34aee70d', 'request_id': 'req-5d7e90f3-ad5c-45f3-be4f-3067b674de57'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.865430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] The token cache is being invalidate because project d0f280fea36f4e1e860e489d34aee70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:57:12.865430 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.866160 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:12.867689 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1470/2908] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:57:12 2022] DELETE /identity/v3/projects/d0f280fea36f4e1e860e489d34aee70d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:57:12.871851 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:57:12.873901 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:12.886922 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a33f0c-6220-47d6-8713-9eb3a91767c8 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:57:12.946631 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:57:12.947308 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:57:12.947592 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:57:12.947868 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] PATH_INFO: `/v3/users/c785ec0dbacc4dbb97a5a9f994bc58bd` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:57:12.949045 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c785ec0dbacc4dbb97a5a9f994bc58bd)` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:57:12.951143 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:57:13.002071 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c785ec0dbacc4dbb97a5a9f994bc58bd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.008978 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c785ec0dbacc4dbb97a5a9f994bc58bd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.009651 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c785ec0dbacc4dbb97a5a9f994bc58bd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.024202 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c785ec0dbacc4dbb97a5a9f994bc58bd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.024886 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.notifications [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c785ec0dbacc4dbb97a5a9f994bc58bd'} {{(pid=88085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.038556 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1439/2909] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 11:57:12 2022] DELETE /identity/v3/users/c785ec0dbacc4dbb97a5a9f994bc58bd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 11:57:13.214423 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] Authenticating user token {{(pid=88086) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:57:13.216427 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.fernet_utils [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88086) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:57:13.235802 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e90f3-ad5c-45f3-be4f-3067b674de57 admin admin] Validating token access rules against request {{(pid=88086) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:57:13.253818 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:57:13.298723 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6889fd2ecc6c467f8af1a4d5c4e42fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '366850b748b7483f9a23090a350c7e5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88086) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:57:13.299372 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:57:13.299654 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:57:13.299928 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] PATH_INFO: `/v3/projects/f679189b5b8f42499ea9d7b1cbe8664e` {{(pid=88086) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:57:13.301048 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f679189b5b8f42499ea9d7b1cbe8664e)` {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:57:13.302991 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] RBAC: Authorization granted {{(pid=88086) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:57:13.349233 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f679189b5b8f42499ea9d7b1cbe8664e', 'request_id': 'req-bf647474-1e3b-4fba-a76e-92cb29713e03'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.355428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f679189b5b8f42499ea9d7b1cbe8664e', 'request_id': 'req-bf647474-1e3b-4fba-a76e-92cb29713e03'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.361630 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f679189b5b8f42499ea9d7b1cbe8664e', 'request_id': 'req-bf647474-1e3b-4fba-a76e-92cb29713e03'} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.374428 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] The token cache is being invalidate because project f679189b5b8f42499ea9d7b1cbe8664e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88086) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:57:13.374726 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.375380 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG keystone.notifications [None req-bf647474-1e3b-4fba-a76e-92cb29713e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88086) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:57:13.376903 dv-cinder-846054-1-smb devstack@keystone.service[88086]: [pid: 88086|app: 0|req: 1471/2910] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 11:57:13 2022] DELETE /identity/v3/projects/f679189b5b8f42499ea9d7b1cbe8664e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:57:23.035104 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=75,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:57:23.370979 dv-cinder-846054-1-smb devstack@keystone.service[88086]: DEBUG dbcounter [-] [88086] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:59:03.814819 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] Authenticating user token {{(pid=88085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:59:03.816254 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:59:03.886162 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a8a97-e620-45c3-9ed9-36a99d9d9d64 admin admin] Validating token access rules against request {{(pid=88085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:59:03.949920 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4f2fb-909a-4065-b027-957f853b4416 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1485acc3d3e649168b8a1c69d0bbf12f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb3430537ddd42f9b69fbbb792f22785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:59:03.950532 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4f2fb-909a-4065-b027-957f853b4416 service placement] REQUEST_METHOD: `GET` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:59:03.950834 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4f2fb-909a-4065-b027-957f853b4416 service placement] SCRIPT_NAME: `/identity` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:59:03.951125 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4f2fb-909a-4065-b027-957f853b4416 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:59:03.952844 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.fernet_utils [None req-09f4f2fb-909a-4065-b027-957f853b4416 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:59:03.964233 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4f2fb-909a-4065-b027-957f853b4416 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:59:03.965789 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4f2fb-909a-4065-b027-957f853b4416 service placement] RBAC: Authorization granted {{(pid=88085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:59:03.975562 dv-cinder-846054-1-smb devstack@keystone.service[88085]: [pid: 88085|app: 0|req: 1440/2911] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 11:59:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:59:13.971369 dv-cinder-846054-1-smb devstack@keystone.service[88085]: DEBUG dbcounter [-] [88085] Writing DB stats keystone:SELECT=58 {{(pid=88085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}